Oct 30 21:19:59.498127 ip-10-0-136-135 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 21:19:59.498265 ip-10-0-136-135 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 21:19:59.498362 ip-10-0-136-135 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 21:19:59.498833 ip-10-0-136-135 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 21:20:09.682776 ip-10-0-136-135 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 21:20:09.682798 ip-10-0-136-135 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a3f38f2b954248f1bb21a57a839ab1c4 --
Oct 30 21:22:07.036212 ip-10-0-136-135 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:22:07.416490 ip-10-0-136-135 kubenswrapper[2543]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:22:07.416490 ip-10-0-136-135 kubenswrapper[2543]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:22:07.416490 ip-10-0-136-135 kubenswrapper[2543]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:22:07.416490 ip-10-0-136-135 kubenswrapper[2543]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:22:07.420168 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420072    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:22:07.420168 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420165    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:22:07.420168 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420169    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:22:07.420168 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420173    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:22:07.420168 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420176    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420179    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420181    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420185    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420187    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420190    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420192    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420195    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420198    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420200    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420203    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420205    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420208    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420210    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420213    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420215    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420218    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420220    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420224    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:22:07.420346 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420229    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420232    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420235    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420239    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420242    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420253    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420256    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420259    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420262    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420265    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420267    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420270    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420272    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420275    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420277    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420281    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420284    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420286    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420289    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420291    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:22:07.420783 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420294    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420296    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420299    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420302    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420304    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420307    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420309    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420311    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420314    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420316    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420319    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420321    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420323    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420327    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420329    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420331    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420334    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420337    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420346    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420349    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:22:07.421284 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420352    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420354    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420357    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420359    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420362    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420364    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420367    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420370    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420372    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420374    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420378    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420380    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420383    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420385    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420387    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420390    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420392    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420395    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420397    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:22:07.421736 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420400    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420402    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420405    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420408    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420410    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420412    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420415    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420417    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420421    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420425    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420428    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420430    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420438    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420441    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420443    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420446    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420448    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420451    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420453    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:22:07.422214 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420456    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420459    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420462    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420465    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.420467    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421382    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421389    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421392    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421395    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421398    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421400    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421403    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421406    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421408    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421410    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421413    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421416    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421419    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421421    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:22:07.422929 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421424    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421426    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421428    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421431    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421434    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421436    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421439    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421447    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421450    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421452    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421455    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421457    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421459    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421462    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421465    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421470    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421475    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421478    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421481    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:22:07.423719 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421484    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421486    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421489    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421491    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421494    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421496    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421499    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421501    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421504    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421507    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421509    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421512    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421514    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421517    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421519    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421521    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421524    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421526    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421529    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421531    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:22:07.424278 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421534    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421541    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421544    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421547    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421549    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421553    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421557    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421560    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421563    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421565    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421568    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421570    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421572    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421575    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421577    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421580    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421583    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421585    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421588    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:22:07.424747 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421590    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421592    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421595    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421598    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421600    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421602    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421605    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421607    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421610    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421613    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421615    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421618    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421620    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421623    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421625    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421633    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421635    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421638    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421640    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:22:07.425267 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421643    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421646    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421648    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421651    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421653    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421655    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421658    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421661    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421663    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421666    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421668    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421670    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421673    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421677    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.421679    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.422996    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423027    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423032    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423037    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423041    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:22:07.426179 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423045    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423050    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423054    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423058    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423062    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423066    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423070    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423074    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423137    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423286    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423298    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423303    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423308    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423312    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423317    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423322    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423328    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423332    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423337    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423341    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:22:07.427114 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423346    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423350    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423354    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423358    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423362    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423367    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423372    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423376    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423386    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423392    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423396    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423401    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423405    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423409    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423413    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423417    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423421    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423426    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423430    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423435    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:22:07.427797 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423439    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423444    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423448    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423453    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423458    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423465    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423470    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423475    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423479    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423483    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423487    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423492    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423499    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423504    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423509    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423513    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423518    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423523    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423527    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:22:07.428480 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423531    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423536    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423540    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423544    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423548    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423552    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423557    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423561    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423565    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423569    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423573    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423577    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423581    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423585    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423589    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423594    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423601    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423607    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423613    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:22:07.429037 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423618    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423623    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423628    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423632    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423636    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423641    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423645    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423649    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423654    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423658    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423662    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423666    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423670    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423675    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423679    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423686    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423690    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423694    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423698    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423703    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:22:07.429535 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423707    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423711    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.423715    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425188    2543 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425204    2543 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425220    2543 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425228    2543 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425236    2543 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425241    2543 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425248    2543 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425254    2543 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425259    2543 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425264    2543 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425281    2543 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425287    2543 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425292    2543 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425298    2543 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425302    2543 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425307    2543 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425311    2543 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425316    2543 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425323    2543 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425327    2543 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425332    2543 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:22:07.430072 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425337    2543 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425342    2543 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425349    2543 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425353    2543 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425358    2543 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425363    2543 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425368    2543 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425373    2543 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425377    2543 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425383    2543 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425387    2543 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425394    2543 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425399    2543 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425404    2543 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425408    2543 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425413    2543 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425417    2543 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425425    2543 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425430    2543 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425434    2543 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425439    2543 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425443    2543 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425457    2543 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425462    2543 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425467    2543 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:22:07.430641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425472    2543 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425477    2543 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425481    2543 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425486    2543 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425490    2543 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425495    2543 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425499    2543 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425504    2543 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425510    2543 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425515    2543 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425520    2543 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425525    2543 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425529    2543 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425534    2543 flags.go:64] FLAG: --help="false"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425539    2543 flags.go:64] FLAG: --hostname-override="ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425544    2543 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425548    2543 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425553    2543 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425558    2543 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425564    2543 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425569    2543 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425573    2543 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425577    2543 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:22:07.431306 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425582    2543 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425587    2543 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425591    2543 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425596    2543 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425600    2543 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425605    2543 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425610    2543 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425621    2543 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425626    2543 flags.go:64] FLAG: --lock-file=""
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425630    2543 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425634    2543 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425639    2543 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425649    2543 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425653    2543 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425658    2543 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425662    2543 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425668    2543 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425673    2543 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425677    2543 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425681    2543 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425688    2543 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425693    2543 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425699    2543 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425704    2543 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425709    2543 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:22:07.431863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425713    2543 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425717    2543 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425722    2543 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425727    2543 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425731    2543 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425743    2543 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425748    2543 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425753    2543 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425758    2543 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425762    2543 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425766    2543 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425771    2543 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425776    2543 flags.go:64] FLAG: --port="10250"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425781    2543 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425785    2543 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0d21c4cca50b2ca51"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425798    2543 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425802    2543 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425807    2543 flags.go:64] FLAG: --register-node="true"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425812    2543 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425818    2543 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425823    2543 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425827    2543 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425831    2543 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425837    2543 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425842    2543 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425847    2543 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:22:07.432529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425851    2543 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425856    2543 flags.go:64] FLAG: --runonce="false"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425860    2543 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425865    2543 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425870    2543 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425875    2543 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425880    2543 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425886    2543 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425891    2543 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425895    2543 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425900    2543 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425904    2543 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425911    2543 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425916    2543 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425921    2543 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425926    2543 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425930    2543 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425940    2543 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425945    2543 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425949    2543 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425956    2543 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425960    2543 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.425995    2543 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.426001    2543 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.426007    2543 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:22:07.433168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.426011    2543 flags.go:64] FLAG: --v="2"
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.426017    2543 flags.go:64] FLAG: --version="false"
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.426024    2543 flags.go:64] FLAG: --vmodule=""
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.426030    2543 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.426035    2543 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426284    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426292    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426297    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426301    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426305    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426310    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426319    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426323    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426327    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426332    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426336    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426340    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426345    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426349    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426356    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:22:07.433746 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426360    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426364    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426368    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426372    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426376    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426381    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426385    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426389    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426393    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426397    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426409    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426414    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426419    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426424    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426428    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426432    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426436    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426441    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426445    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426449    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:22:07.434235 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426454    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426458    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426462    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426468    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426472    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426476    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426480    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426484    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426488    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426493    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426497    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426502    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426507    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426512    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426516    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426521    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426525    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426529    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426533    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:22:07.434802 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426537    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426543    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426549    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426555    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426568    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426574    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426581    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426587    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426592    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426596    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426602    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426607    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426611    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426616    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426620    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426624    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426630    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426634    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426639    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:22:07.435282 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426643    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426649    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426655    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426659    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426664    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426669    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426674    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426678    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426682    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426686    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426690    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426694    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426699    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426703    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426707    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426711    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426715    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426720    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426732    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:22:07.435738 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426736    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426740    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426744    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426748    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426752    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426757    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426761    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426765    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426769    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426773    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426778    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426783    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426787    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426791    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.426833    2543 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426906    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:22:07.436194 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426912    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426918    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426925    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426929    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426934    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426938    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426942    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426946    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426950    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426955    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426959    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426982    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426986    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426992    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.426996    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427003    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427017    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427021    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427026    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:22:07.436599 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427030    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427034    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427039    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427043    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427047    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427052    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427057    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427061    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427066    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427071    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427076    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427080    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427085    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427089    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427093    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427099    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427103    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427107    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427111    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427115    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:22:07.437132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427119    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427123    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427127    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427131    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427135    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427139    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427143    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427148    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427153    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427157    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427169    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427173    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427180    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427187    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427192    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427197    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427201    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427206    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427210    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:22:07.437602 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427214    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427219    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427224    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427228    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427232    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427236    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427240    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427244    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427251    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427255    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427259    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427263    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427269    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427275    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427280    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427286    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427290    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427294    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427298    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:22:07.438049 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427302    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427306    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427310    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427314    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427319    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427331    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427336    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427340    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427344    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427348    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427352    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427356    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427361    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427365    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427371    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427376    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427380    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427384    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427389    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427393    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:22:07.438488 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427397    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427403    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427407    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427413    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427418    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427422    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427426    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.427430    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.434076    2543 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.434092    2543 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.434109    2543 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.434114    2543 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434168    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434173    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434177    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434180    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434183    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434185    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434188    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434191    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:22:07.438952 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434193    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434196    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434199    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434202    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434204    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434207    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434209    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434212    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434214    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434217    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434220    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434222    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434225    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434227    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434230    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434232    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434235    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434238    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434241    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:22:07.439439 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434243    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434246    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434250    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434252    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434255    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434257    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434260    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434262    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434265    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434267    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434270    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434272    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434274    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434277    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434280    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434282    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434285    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434287    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434289    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434292    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:22:07.439892 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434294    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434297    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434299    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434302    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434304    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434307    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434310    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434312    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434314    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434317    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434320    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434322    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434325    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434327    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434330    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434333    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434335    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434338    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434340    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434343    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:22:07.440382 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434345    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434347    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434350    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434352    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434354    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434357    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434359    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434362    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434364    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434367    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434369    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434372    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434374    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434376    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434379    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434381    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434383    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434386    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434389    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:22:07.440837 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434391    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434394    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434396    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434399    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434401    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434404    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434406    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434408    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434411    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434414    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434416    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434419    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434421    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434423    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434426    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434428    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434431    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434433    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:22:07.441304 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434437    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434441    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.434473    2543 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434606    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434610    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434613    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434615    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434618    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434621    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434623    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434625    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434628    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434630    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434633    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434635    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434638    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:22:07.441751 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434640    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434643    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434645    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434647    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434650    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434653    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434655    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434658    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434661    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434663    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434666    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434669    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434672    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434674    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434677    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434679    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434682    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434685    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434687    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:22:07.442149 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434690    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434692    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434694    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434697    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434699    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434702    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434704    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434707    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434709    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434712    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434714    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434716    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434719    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434721    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434724    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434726    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434729    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434731    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434733    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434736    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:22:07.442589 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434738    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434741    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434744    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434747    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434749    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434752    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434755    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434757    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434760    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434762    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434764    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434767    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434769    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434772    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434774    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434777    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434779    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434781    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434784    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:22:07.443080 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434786    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434790    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434793    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434796    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434799    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434801    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434805    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434809    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434812    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434814    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434817    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434819    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434822    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434824    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434826    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434829    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434832    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434834    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434837    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:22:07.443587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434839    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434842    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434844    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434847    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434849    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434852    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434854    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434856    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434859    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434861    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434863    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434866    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434868    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434870    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434873    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434875    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:22:07.444038 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.434897    2543 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434945    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434949    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434952    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434955    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434958    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434975    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434979    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434981    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434984    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434986    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434989    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434991    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434994    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.434997    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435000    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435002    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435004    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435007    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435009    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:22:07.444412 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435012    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435015    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435017    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435020    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435022    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435024    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435027    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435029    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435031    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435034    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435036    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435039    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435041    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435043    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435046    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435048    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435051    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435053    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435055    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435058    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:22:07.444871 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435060    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435062    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435065    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435067    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435069    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435072    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435074    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435077    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435080    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435085    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435088    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435091    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435093    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435096    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435098    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435101    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435103    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435106    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435108    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:22:07.445411 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435111    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435113    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435115    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435118    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435120    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435123    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435125    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435127    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435130    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435132    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435135    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435137    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435140    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435143    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435146    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435148    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435150    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435153    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435155    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:22:07.446061 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435158    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435160    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435163    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435167    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435170    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435172    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435174    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435177    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435180    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435182    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435185    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435187    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435190    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435192    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435195    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435198    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435201    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435204    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435206    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435209    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:22:07.446557 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435211    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435213    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435216    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435219    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435221    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435224    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435226    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435228    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:07.435233    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.435289    2543 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.437087    2543 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.437864    2543 server.go:1014] "Starting client certificate rotation"
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.438006    2543 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.438038    2543 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.439465    2543 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:22:07.447034 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.440541    2543 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:22:07.450490 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.450476    2543 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:22:07.454243 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.454218    2543 log.go:25] "Validated CRI v1 image API"
Oct 30 21:22:07.455135 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.455107    2543 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:22:07.460439 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.460421    2543 fs.go:135] Filesystem UUIDs: map[5aa3fe11-8ec0-4514-b69d-f68c6c24f883:/dev/nvme0n1p4 639423a0-3bd7-4e2a-bc17-7f1772c0252e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 21:22:07.460497 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.460439    2543 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 21:22:07.467205 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.467098    2543 manager.go:217] Machine: {Timestamp:2026-10-30 21:22:07.465377266 +0000 UTC m=+0.307184331 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101269 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f3fea266c5c54f0f2ba1fc59f9914 SystemUUID:ec2f3fea-266c-5c54-f0f2-ba1fc59f9914 BootID:a3f38f2b-9542-48f1-bb21-a57a839ab1c4 Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:50:f0:6f:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:50:f0:6f:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:fd:3c:59:6b:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:22:07.467205 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.467205    2543 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:22:07.467311 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.467301    2543 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:22:07.471532 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.471505    2543 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:22:07.471654 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.471535    2543 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-135.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:22:07.471696 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.471656    2543 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:22:07.471696 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.471663    2543 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:22:07.471696 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.471687    2543 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:22:07.471774 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.471699    2543 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:22:07.472304 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.472295    2543 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:22:07.476094 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.476083    2543 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:22:07.476214 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.476204    2543 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:22:07.476655 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.476646    2543 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:22:07.476682 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.476659    2543 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:22:07.476682 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.476669    2543 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:22:07.476682 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.476678    2543 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:22:07.476761 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.476687    2543 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:22:07.476992 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.476981    2543 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:22:07.479247 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.479226    2543 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:22:07.484320 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.484308    2543 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:22:07.485293 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.485279    2543 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:22:07.485334 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.485312    2543 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:22:07.485491 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.485480    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:22:07.485520 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.485498    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:22:07.485520 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.485504    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:22:07.485520 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.485510    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:22:07.485520 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.485515    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:22:07.485520 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.485521    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:22:07.486007 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.485998    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:22:07.486042 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.486008    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:22:07.486042 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.486015    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:22:07.486042 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.486027    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:22:07.486042 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.486040    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:22:07.486239 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.486049    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:22:07.488586 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.488576    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:22:07.488625 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.488587    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:22:07.492346 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.492334    2543 server.go:1263] "Started kubelet"
Oct 30 21:22:07.492448 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.492412    2543 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:22:07.492508 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.492422    2543 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:22:07.492508 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.492488    2543 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:22:07.492927 ip-10-0-136-135 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:22:07.493499 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.493395    2543 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:22:07.494014 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.494000    2543 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:22:07.499766 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.499739    2543 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:22:07.500114 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.500094    2543 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:22:07.500198 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:07.500169    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-135.us-west-1.compute.internal\" not found"
Oct 30 21:22:07.500603 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:07.500573    2543 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 21:22:07.500693 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.500656    2543 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:22:07.500693 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.500673    2543 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:22:07.500797 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.500770    2543 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:22:07.500849 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.500812    2543 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:22:07.500849 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.500820    2543 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:22:07.501313 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.501297    2543 factory.go:55] Registering systemd factory
Oct 30 21:22:07.501313 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.501313    2543 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:22:07.501716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.501702    2543 factory.go:153] Registering CRI-O factory
Oct 30 21:22:07.501762 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.501721    2543 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:22:07.501790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.501767    2543 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:22:07.501790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.501781    2543 factory.go:103] Registering Raw factory
Oct 30 21:22:07.501846 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.501797    2543 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:22:07.503736 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.503720    2543 manager.go:319] Starting recovery of all containers
Oct 30 21:22:07.514159 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.514144    2543 manager.go:324] Recovery completed
Oct 30 21:22:07.519089 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.519077    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:22:07.520654 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.520628    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:22:07.520728 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.520663    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:22:07.520728 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.520673    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:22:07.521202 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.521185    2543 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:22:07.521202 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.521201    2543 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:22:07.521333 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.521219    2543 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:22:07.521333 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.521221    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:22:07.522141 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.522126    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:22:07.522187 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.522153    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:22:07.522187 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.522166    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:22:07.523453 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.523441    2543 policy_none.go:50] "Start"
Oct 30 21:22:07.523517 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.523459    2543 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:22:07.523517 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.523471    2543 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:22:07.525567 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.525554    2543 policy_none.go:44] "Start"
Oct 30 21:22:07.560611 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.560484    2543 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:22:07.564334 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.564320    2543 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:22:07.564420 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:07.564348    2543 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:22:07.564420 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.564356    2543 server.go:87] "Starting device plugin registration server"
Oct 30 21:22:07.564585 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.564573    2543 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:22:07.564641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.564587    2543 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:22:07.564701 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.564683    2543 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:22:07.564902 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.564825    2543 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:22:07.564902 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.564838    2543 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:22:07.565263 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:07.565244    2543 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:22:07.565334 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:07.565295    2543 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-135.us-west-1.compute.internal\" not found"
Oct 30 21:22:07.638692 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.638664    2543 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:22:07.640711 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.639951    2543 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:22:07.640711 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.639985    2543 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:22:07.640711 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.640002    2543 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:22:07.640711 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:07.640035    2543 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 21:22:07.665017 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.664998    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:22:07.665758 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.665745    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:22:07.665814 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.665771    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:22:07.665814 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.665782    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:22:07.665814 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.665804    2543 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.719709 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.719666    2543 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:22:07.719775 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.719720    2543 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cjp97"
Oct 30 21:22:07.740732 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.740707    2543 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"]
Oct 30 21:22:07.740782 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.740762    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:22:07.741496 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.741481    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:22:07.741556 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.741507    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:22:07.741556 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.741517    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:22:07.743689 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.743678    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:22:07.743851 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.743837    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.743894 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.743872    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:22:07.744361 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.744347    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:22:07.744361 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.744356    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:22:07.744444 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.744377    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:22:07.744444 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.744394    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:22:07.744444 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.744378    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:22:07.744579 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.744456    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:22:07.746522 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.746506    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.746587 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.746528    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:22:07.747144 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.747128    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:22:07.747229 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.747160    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:22:07.747229 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.747174    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:22:07.768446 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:07.768431    2543 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-135.us-west-1.compute.internal\" not found" node="ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.770747 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:07.770732    2543 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-135.us-west-1.compute.internal\" not found" node="ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.801979 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.801954    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.802080 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.801989    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.802080 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.802005    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/318fdbac2e696c24464ab55f83e20597-config\") pod \"kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"318fdbac2e696c24464ab55f83e20597\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.803245 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.803229    2543 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:22:07.803245 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.803234    2543 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:22:07.805517 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.805503    2543 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:22:07.902415 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.902391    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.902522 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.902419    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.902522 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.902444    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/318fdbac2e696c24464ab55f83e20597-config\") pod \"kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"318fdbac2e696c24464ab55f83e20597\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.902522 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.902468    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.902522 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.902486    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/318fdbac2e696c24464ab55f83e20597-config\") pod \"kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"318fdbac2e696c24464ab55f83e20597\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.902690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.902530    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.902690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.902623    2543 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:22:07.902690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:07.902653    2543 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:07.902690 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:07.902673    2543 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-135.us-west-1.compute.internal\": node \"ip-10-0-136-135.us-west-1.compute.internal\" not found"
Oct 30 21:22:08.001366 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.001318    2543 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:08.071438 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.071422    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:08.073579 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.073561    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:08.124784 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.124767    2543 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:22:08.125415 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.125403    2543 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:22:08.185219 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.185205    2543 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:22:08.438192 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.438173    2543 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 21:22:08.438619 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.438320    2543 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:22:08.438619 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.438334    2543 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:22:08.438619 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.438355    2543 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:22:08.438619 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.438338    2543 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://af1d03f21ae4249649589735f9d6a3af-3cfe10bb520c60ba.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-136-135.us-west-1.compute.internal.18e36b8c6eb6f92c\": read tcp 10.0.136.135:34662->18.217.85.158:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-136-135.us-west-1.compute.internal.18e36b8c6eb6f92c  default   4840 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-135.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-135.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-135.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:22:07 +0000 UTC,LastTimestamp:2026-10-30 21:22:07.665775815 +0000 UTC m=+0.507582879,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-135.us-west-1.compute.internal,}"
Oct 30 21:22:08.476986 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.476956    2543 apiserver.go:52] "Watching apiserver"
Oct 30 21:22:08.500435 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.500417    2543 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 21:22:08.724521 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.724458    2543 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:17:08 +0000 UTC" deadline="2028-08-08 07:31:13.87210924 +0000 UTC"
Oct 30 21:22:08.724521 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.724488    2543 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15538h9m5.147623935s"
Oct 30 21:22:08.751886 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.751861    2543 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:22:08.752208 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.752189    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-qm2pw","openshift-image-registry/node-ca-k4gdh","openshift-multus/multus-4p5ng","openshift-network-operator/iptables-alerter-25zhv","openshift-ovn-kubernetes/ovnkube-node-lsvj4","kube-system/global-pull-secret-syncer-s4z6n","kube-system/konnectivity-agent-5szpn","kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal","openshift-dns/node-resolver-cgnp7","openshift-multus/multus-additional-cni-plugins-k4wl2","openshift-multus/network-metrics-daemon-vps4x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn","openshift-cluster-node-tuning-operator/tuned-2gbd4"]
Oct 30 21:22:08.754610 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.754593    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:08.754695 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.754676    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:08.756589 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.756573    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.758591 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.758575    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.760562 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.760544    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.762628 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.762613    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.764671 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.764655    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:08.764776 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.764754    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:08.766731 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.766715    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:08.768783 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.768767    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.770908 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.770892    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.773179 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.773165    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:08.773260 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.773225    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:08.775446 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.775431    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.777507 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.777484    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.802161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.802145    2543 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:22:08.806737 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.806716    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-system-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.806822 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.806754    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-cnibin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.806822 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.806780    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-daemon-config\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.806929 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.806875    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-multus-certs\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.806929 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.806910    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-netd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.807051 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.806934    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.807051 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.806960    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-etc-kubernetes\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.807051 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807029    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.807199 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807079    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysconfig\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.807199 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807134    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-var-lib-kubelet\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.807199 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807158    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m67j\" (UniqueName: \"kubernetes.io/projected/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-kube-api-access-8m67j\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.807199 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807190    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-node-log\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.807343 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807219    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.807343 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807243    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-script-lib\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.807343 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807282    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-agent-certs\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:08.807343 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807315    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-binary-copy\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.807343 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807342    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-tmp\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.807549 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807367    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-bin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.807549 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807390    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-conf-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.807549 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807413    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swsv4\" (UniqueName: \"kubernetes.io/projected/a5816f96-8b2e-4f04-a675-500b2a4044df-kube-api-access-swsv4\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.807549 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807438    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.807549 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807474    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z6nn\" (UniqueName: \"kubernetes.io/projected/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-kube-api-access-5z6nn\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.807549 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807505    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjh4n\" (UniqueName: \"kubernetes.io/projected/b9c410c1-b967-4f7c-8478-ff14cd4696b3-kube-api-access-cjh4n\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:08.807549 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807544    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-etc-selinux\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.807790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807568    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-run\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.807790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807593    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-cni-binary-copy\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.807790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807623    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-ovn\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.807790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807650    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-log-socket\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.807790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807673    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rcbl\" (UniqueName: \"kubernetes.io/projected/2523fa7a-1747-4695-a737-5c2a1caf2864-kube-api-access-4rcbl\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.807790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807701    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-host-slash\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.807790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807726    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-dbus\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:08.807790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807750    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cnibin\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.807790 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807779    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-kubernetes\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807802    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-etc-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807831    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-multus\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807859    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-konnectivity-ca\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807880    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807901    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-systemd\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807923    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d57sr\" (UniqueName: \"kubernetes.io/projected/204ffe78-eee5-4cf4-9eb3-23a4034a26af-kube-api-access-d57sr\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807941    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-device-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.807956    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-modprobe-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808003    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-sys\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808029    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-netns\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808051    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-hostroot\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.808090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808075    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-system-cni-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808102    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808124    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-host\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808160    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808185    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-var-lib-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808206    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2523fa7a-1747-4695-a737-5c2a1caf2864-hosts-file\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808229    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808290    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-systemd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808321    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808344    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-serviceca\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808369    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-config\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808392    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-host\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808415    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-kubelet\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808438    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-systemd-units\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808461    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hg5t\" (UniqueName: \"kubernetes.io/projected/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-kube-api-access-9hg5t\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808516    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-socket-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.808571 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808550    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-sys-fs\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808580    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-conf\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808615    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-lib-modules\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808662    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-k8s-cni-cncf-io\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808701    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-env-overrides\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808723    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2523fa7a-1747-4695-a737-5c2a1caf2864-tmp-dir\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808746    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gwjc\" (UniqueName: \"kubernetes.io/projected/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-kube-api-access-4gwjc\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808769    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxl2t\" (UniqueName: \"kubernetes.io/projected/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kube-api-access-nxl2t\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808791    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-tuned\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808819    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-kubelet\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808845    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-slash\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808870    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-netns\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808887    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808901    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-iptables-alerter-script\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808914    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808930    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-socket-dir-parent\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.809161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.808984    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-bin\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.809687 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.809006    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovn-node-metrics-cert\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.809687 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.809045    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-kubelet-config\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:08.809687 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.809094    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.809687 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.809112    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-registration-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.809687 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.809135    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:22:08.809687 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.809184    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:22:08.809687 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.809195    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:22:08.809887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.809764    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rf4nn\""
Oct 30 21:22:08.810540 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.810527    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:22:08.810774 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.810763    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-vm9q9\""
Oct 30 21:22:08.811080 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.811065    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:22:08.811185 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.811173    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:22:08.811263 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.811252    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:22:08.812593 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.812581    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:22:08.812918 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.812904    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v6bcb\""
Oct 30 21:22:08.813007 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.812990    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:22:08.813070 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.813058    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:22:08.815592 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.815579    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:22:08.815785 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.815770    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:22:08.815929 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.815873    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:22:08.816094 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.816040    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:22:08.816136 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.816101    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:22:08.816222 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.816201    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gmgqb\""
Oct 30 21:22:08.816436 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.816424    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:22:08.854910 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.854885    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-ntkmx\""
Oct 30 21:22:08.854910 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.854893    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:22:08.857037 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.857024    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:22:08.857097 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.857045    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:22:08.857353 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.857333    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:22:08.857413 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.857335    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:22:08.857413 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.857393    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:22:08.859337 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.859313    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lclr\""
Oct 30 21:22:08.859428 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.859360    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:22:08.859428 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.859391    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gkfxf\""
Oct 30 21:22:08.859606 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.859595    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:22:08.859641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.859617    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:22:08.859996 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.859985    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:22:08.860312 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.860297    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xqzlq\""
Oct 30 21:22:08.860400 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.860388    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:22:08.860452 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.860389    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mbjr2\""
Oct 30 21:22:08.860452 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.860444    2543 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:22:08.860532 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.860492    2543 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8bb4q"
Oct 30 21:22:08.909804 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909787    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-etc-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.909894 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909810    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-multus\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.909894 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909839    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-konnectivity-ca\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:08.909894 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909856    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.909894 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909871    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-systemd\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.909894 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909886    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d57sr\" (UniqueName: \"kubernetes.io/projected/204ffe78-eee5-4cf4-9eb3-23a4034a26af-kube-api-access-d57sr\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909905    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-device-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909911    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-multus\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909927    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-modprobe-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909934    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-etc-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909949    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-sys\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909988    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-systemd\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.909990    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-netns\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910035    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910051    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-sys\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910046    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-hostroot\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910004    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-device-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910077    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-hostroot\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910085    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-modprobe-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910094    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-system-cni-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910120    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910122    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-netns\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910145    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-system-cni-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.910175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910143    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-host\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910158    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910180    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-host\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910197    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910228    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-var-lib-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910248    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2523fa7a-1747-4695-a737-5c2a1caf2864-hosts-file\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910272    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910294    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-var-lib-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910297    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-systemd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910342    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2523fa7a-1747-4695-a737-5c2a1caf2864-hosts-file\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910350    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910366    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910337    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-systemd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910384    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-serviceca\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910399    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-config\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910458    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-konnectivity-ca\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910499    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-host\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910518    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-kubelet\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.910955 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910532    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-systemd-units\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910547    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hg5t\" (UniqueName: \"kubernetes.io/projected/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-kube-api-access-9hg5t\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910604    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-host\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910612    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-systemd-units\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910613    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-kubelet\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910637    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-socket-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910657    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-sys-fs\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910671    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-conf\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910690    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-lib-modules\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910715    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-k8s-cni-cncf-io\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910726    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-sys-fs\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910738    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-env-overrides\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910760    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2523fa7a-1747-4695-a737-5c2a1caf2864-tmp-dir\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910784    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gwjc\" (UniqueName: \"kubernetes.io/projected/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-kube-api-access-4gwjc\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910807    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxl2t\" (UniqueName: \"kubernetes.io/projected/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kube-api-access-nxl2t\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910822    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-conf\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910828    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-tuned\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.911716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910822    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-lib-modules\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910843    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-socket-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910853    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-serviceca\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910865    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910871    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-k8s-cni-cncf-io\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910907    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-kubelet\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910937    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-slash\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910942    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-config\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910990    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-slash\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.910991    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-kubelet\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911019    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-netns\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911043    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911059    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-iptables-alerter-script\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911074    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911097    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-socket-dir-parent\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911099    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-netns\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911119    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-bin\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.912599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911142    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovn-node-metrics-cert\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911147    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2523fa7a-1747-4695-a737-5c2a1caf2864-tmp-dir\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911153    2543 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911169    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-kubelet-config\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.911184    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911195    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911220    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-registration-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911235    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-bin\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.911250    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret podName:a5515bc6-8312-4be8-999c-9072fa30b526 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:09.411229314 +0000 UTC m=+2.253036380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret") pod "global-pull-secret-syncer-s4z6n" (UID: "a5515bc6-8312-4be8-999c-9072fa30b526") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.911252    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911270    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-system-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911274    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-registration-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.911286    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs podName:b9c410c1-b967-4f7c-8478-ff14cd4696b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:09.411276183 +0000 UTC m=+2.253083249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs") pod "network-metrics-daemon-vps4x" (UID: "b9c410c1-b967-4f7c-8478-ff14cd4696b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911293    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-socket-dir-parent\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911293    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-env-overrides\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911311    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-cnibin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911316    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-system-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.913407 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911336    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-daemon-config\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911342    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-kubelet-config\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911360    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-multus-certs\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911369    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-cnibin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911385    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-netd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911407    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-multus-certs\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911410    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911436    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-etc-kubernetes\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911458    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911480    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysconfig\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911504    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-var-lib-kubelet\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911529    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m67j\" (UniqueName: \"kubernetes.io/projected/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-kube-api-access-8m67j\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911553    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-node-log\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911554    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911577    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911592    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-netd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911596    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-iptables-alerter-script\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.914173 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911602    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-script-lib\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911627    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-agent-certs\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911634    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-var-lib-kubelet\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911654    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911655    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-binary-copy\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911674    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysconfig\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911695    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-tmp\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911713    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-node-log\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911721    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-bin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911742    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911754    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911745    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-conf-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911775    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-conf-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911789    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swsv4\" (UniqueName: \"kubernetes.io/projected/a5816f96-8b2e-4f04-a675-500b2a4044df-kube-api-access-swsv4\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911815    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911840    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z6nn\" (UniqueName: \"kubernetes.io/projected/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-kube-api-access-5z6nn\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911855    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-daemon-config\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.914690 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911863    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjh4n\" (UniqueName: \"kubernetes.io/projected/b9c410c1-b967-4f7c-8478-ff14cd4696b3-kube-api-access-cjh4n\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911894    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-etc-selinux\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911920    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-run\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911946    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-cni-binary-copy\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.911990    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-ovn\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912014    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-log-socket\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912037    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rcbl\" (UniqueName: \"kubernetes.io/projected/2523fa7a-1747-4695-a737-5c2a1caf2864-kube-api-access-4rcbl\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912049    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912063    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-host-slash\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912076    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-run\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912094    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-host-slash\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912102    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-dbus\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912144    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cnibin\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912170    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-kubernetes\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912223    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-kubernetes\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912250    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-ovn\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912275    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cnibin\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912309    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-bin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.915250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912336    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-dbus\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:08.916321 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912385    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-log-socket\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.916321 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912393    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-etc-selinux\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.916321 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.912626    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-etc-kubernetes\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.916321 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.914611    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovn-node-metrics-cert\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.916321 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.915094    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-script-lib\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.916321 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.915130    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-tuned\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.916321 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.915265    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-tmp\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.916321 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.915291    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-cni-binary-copy\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.916321 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.915332    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-binary-copy\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.917226 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.917210    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-agent-certs\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:08.969949 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.969928    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:22:08.970065 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.969953    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:22:08.970065 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.969981    2543 projected.go:196] Error preparing data for projected volume kube-api-access-jpjm4 for pod openshift-network-diagnostics/network-check-target-qm2pw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:08.970065 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:08.970035    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4 podName:0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f nodeName:}" failed. No retries permitted until 2026-10-30 21:22:09.470017964 +0000 UTC m=+2.311825028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jpjm4" (UniqueName: "kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4") pod "network-check-target-qm2pw" (UID: "0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:08.972520 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.972493    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m67j\" (UniqueName: \"kubernetes.io/projected/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-kube-api-access-8m67j\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:08.972979 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.972926    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z6nn\" (UniqueName: \"kubernetes.io/projected/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-kube-api-access-5z6nn\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:08.973053 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.972993    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swsv4\" (UniqueName: \"kubernetes.io/projected/a5816f96-8b2e-4f04-a675-500b2a4044df-kube-api-access-swsv4\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:08.973053 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.973005    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d57sr\" (UniqueName: \"kubernetes.io/projected/204ffe78-eee5-4cf4-9eb3-23a4034a26af-kube-api-access-d57sr\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:08.973053 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.973019    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gwjc\" (UniqueName: \"kubernetes.io/projected/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-kube-api-access-4gwjc\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:08.973163 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.973144    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxl2t\" (UniqueName: \"kubernetes.io/projected/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kube-api-access-nxl2t\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:08.973196 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.973156    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hg5t\" (UniqueName: \"kubernetes.io/projected/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-kube-api-access-9hg5t\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:08.977302 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.977247    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rcbl\" (UniqueName: \"kubernetes.io/projected/2523fa7a-1747-4695-a737-5c2a1caf2864-kube-api-access-4rcbl\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:08.977745 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:08.977726    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjh4n\" (UniqueName: \"kubernetes.io/projected/b9c410c1-b967-4f7c-8478-ff14cd4696b3-kube-api-access-cjh4n\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:09.097108 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.097078    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:22:09.107699 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.107678    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:22:09.123610 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.123590    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4p5ng"
Oct 30 21:22:09.138544 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.138522    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:22:09.160328 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.160309    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:09.169080 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.169063    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:09.171161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.171143    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:22:09.172376 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:09.172346    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f630f6b_6df2_4c78_9aff_8f2577cfb56c.slice/crio-411f593ca59e307403fbfe8c0486962149536921600f7894a786621e329dee04 WatchSource:0}: Error finding container 411f593ca59e307403fbfe8c0486962149536921600f7894a786621e329dee04: Status 404 returned error can't find the container with id 411f593ca59e307403fbfe8c0486962149536921600f7894a786621e329dee04
Oct 30 21:22:09.172953 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:09.172931    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod318fdbac2e696c24464ab55f83e20597.slice/crio-6a16b8bcb0c04e38e3802c062bafc0373e7be3e531e33a78e3c68182d3c1c465 WatchSource:0}: Error finding container 6a16b8bcb0c04e38e3802c062bafc0373e7be3e531e33a78e3c68182d3c1c465: Status 404 returned error can't find the container with id 6a16b8bcb0c04e38e3802c062bafc0373e7be3e531e33a78e3c68182d3c1c465
Oct 30 21:22:09.173534 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:09.173511    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822b5a15_b6cd_4106_b4c7_76ae8d6db19a.slice/crio-88e3eca136b571a6f05b7ff58fdf07b2810178d981214344276d32cef01e0118 WatchSource:0}: Error finding container 88e3eca136b571a6f05b7ff58fdf07b2810178d981214344276d32cef01e0118: Status 404 returned error can't find the container with id 88e3eca136b571a6f05b7ff58fdf07b2810178d981214344276d32cef01e0118
Oct 30 21:22:09.174268 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:09.174246    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24abb3b3ef955062440aec6d22d39298.slice/crio-2ddd9e3718a9ca803e5295740438bd22a6137393f9e2c01e094be5bed6b62856 WatchSource:0}: Error finding container 2ddd9e3718a9ca803e5295740438bd22a6137393f9e2c01e094be5bed6b62856: Status 404 returned error can't find the container with id 2ddd9e3718a9ca803e5295740438bd22a6137393f9e2c01e094be5bed6b62856
Oct 30 21:22:09.177056 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.177040    2543 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:22:09.180126 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:09.180107    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5fef5d7_aeae_4377_b42a_18ca1db1aef4.slice/crio-efeeb148cce4ca1b9ed2689a1996a7bc599bb97394aac89ce8c6d32aed3489ef WatchSource:0}: Error finding container efeeb148cce4ca1b9ed2689a1996a7bc599bb97394aac89ce8c6d32aed3489ef: Status 404 returned error can't find the container with id efeeb148cce4ca1b9ed2689a1996a7bc599bb97394aac89ce8c6d32aed3489ef
Oct 30 21:22:09.182243 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:09.182226    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2523fa7a_1747_4695_a737_5c2a1caf2864.slice/crio-45e3498274ac8c535a804bfd4c3f5a3f947344734b83274266473a12d494c60d WatchSource:0}: Error finding container 45e3498274ac8c535a804bfd4c3f5a3f947344734b83274266473a12d494c60d: Status 404 returned error can't find the container with id 45e3498274ac8c535a804bfd4c3f5a3f947344734b83274266473a12d494c60d
Oct 30 21:22:09.193455 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.193431    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:22:09.200136 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.200121    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:22:09.201587 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:09.201566    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204ffe78_eee5_4cf4_9eb3_23a4034a26af.slice/crio-f190fc0f45e03794d68c089f7b07263d4dde7efaf3458155513e4831778cd142 WatchSource:0}: Error finding container f190fc0f45e03794d68c089f7b07263d4dde7efaf3458155513e4831778cd142: Status 404 returned error can't find the container with id f190fc0f45e03794d68c089f7b07263d4dde7efaf3458155513e4831778cd142
Oct 30 21:22:09.208132 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:09.208114    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7026bee2_54f0_43f2_aaeb_b7c81acd5e68.slice/crio-b69c6a2460fb985f25490237971cdb1e4f78953b75a9b1f7ac2c9528e8fb1d36 WatchSource:0}: Error finding container b69c6a2460fb985f25490237971cdb1e4f78953b75a9b1f7ac2c9528e8fb1d36: Status 404 returned error can't find the container with id b69c6a2460fb985f25490237971cdb1e4f78953b75a9b1f7ac2c9528e8fb1d36
Oct 30 21:22:09.417279 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.417250    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:09.417449 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.417284    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:09.417449 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:09.417385    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:09.417449 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:09.417390    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:09.417449 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:09.417433    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs podName:b9c410c1-b967-4f7c-8478-ff14cd4696b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:10.417421836 +0000 UTC m=+3.259228901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs") pod "network-metrics-daemon-vps4x" (UID: "b9c410c1-b967-4f7c-8478-ff14cd4696b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:09.417449 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:09.417445    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret podName:a5515bc6-8312-4be8-999c-9072fa30b526 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:10.417439089 +0000 UTC m=+3.259246140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret") pod "global-pull-secret-syncer-s4z6n" (UID: "a5515bc6-8312-4be8-999c-9072fa30b526") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:09.518209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.518178    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:09.518802 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:09.518332    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:22:09.518802 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:09.518353    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:22:09.518802 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:09.518363    2543 projected.go:196] Error preparing data for projected volume kube-api-access-jpjm4 for pod openshift-network-diagnostics/network-check-target-qm2pw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:09.518802 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:09.518415    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4 podName:0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f nodeName:}" failed. No retries permitted until 2026-10-30 21:22:10.518398496 +0000 UTC m=+3.360205549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jpjm4" (UniqueName: "kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4") pod "network-check-target-qm2pw" (UID: "0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:09.644415 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.644369    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal" event={"ID":"24abb3b3ef955062440aec6d22d39298","Type":"ContainerStarted","Data":"2ddd9e3718a9ca803e5295740438bd22a6137393f9e2c01e094be5bed6b62856"}
Oct 30 21:22:09.645529 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.645503    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-25zhv" event={"ID":"822b5a15-b6cd-4106-b4c7-76ae8d6db19a","Type":"ContainerStarted","Data":"88e3eca136b571a6f05b7ff58fdf07b2810178d981214344276d32cef01e0118"}
Oct 30 21:22:09.646599 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.646576    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" event={"ID":"7026bee2-54f0-43f2-aaeb-b7c81acd5e68","Type":"ContainerStarted","Data":"b69c6a2460fb985f25490237971cdb1e4f78953b75a9b1f7ac2c9528e8fb1d36"}
Oct 30 21:22:09.647713 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.647691    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2gbd4" event={"ID":"204ffe78-eee5-4cf4-9eb3-23a4034a26af","Type":"ContainerStarted","Data":"f190fc0f45e03794d68c089f7b07263d4dde7efaf3458155513e4831778cd142"}
Oct 30 21:22:09.648875 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.648856    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cgnp7" event={"ID":"2523fa7a-1747-4695-a737-5c2a1caf2864","Type":"ContainerStarted","Data":"45e3498274ac8c535a804bfd4c3f5a3f947344734b83274266473a12d494c60d"}
Oct 30 21:22:09.650042 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.650019    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" event={"ID":"b5fef5d7-aeae-4377-b42a-18ca1db1aef4","Type":"ContainerStarted","Data":"efeeb148cce4ca1b9ed2689a1996a7bc599bb97394aac89ce8c6d32aed3489ef"}
Oct 30 21:22:09.651126 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.651106    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5szpn" event={"ID":"7f630f6b-6df2-4c78-9aff-8f2577cfb56c","Type":"ContainerStarted","Data":"411f593ca59e307403fbfe8c0486962149536921600f7894a786621e329dee04"}
Oct 30 21:22:09.652225 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.652204    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal" event={"ID":"318fdbac2e696c24464ab55f83e20597","Type":"ContainerStarted","Data":"6a16b8bcb0c04e38e3802c062bafc0373e7be3e531e33a78e3c68182d3c1c465"}
Oct 30 21:22:09.656002 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.655969    2543 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:22:09.747834 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.747782    2543 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:22:09.863390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.863341    2543 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:17:09 +0000 UTC" deadline="2028-08-12 22:22:12.880651748 +0000 UTC"
Oct 30 21:22:09.863484 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.863394    2543 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15649h0m3.017271565s"
Oct 30 21:22:09.925849 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:09.925824    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e60dadc_7b2d_47e1_930e_fbfb5a1c9534.slice/crio-74bc8edbf0633a2bb226c5ad5ecd03561b6ca4f84052268ddecbac6a9b3a93f4 WatchSource:0}: Error finding container 74bc8edbf0633a2bb226c5ad5ecd03561b6ca4f84052268ddecbac6a9b3a93f4: Status 404 returned error can't find the container with id 74bc8edbf0633a2bb226c5ad5ecd03561b6ca4f84052268ddecbac6a9b3a93f4
Oct 30 21:22:09.992288 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:09.992261    2543 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:22:10.006352 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:10.006317    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfa550e_e2f4_4549_993f_5bbe3ebac5c2.slice/crio-855d815d22495e18c1befba8c75560ae9983b8459aab715138cc70c8286b4581 WatchSource:0}: Error finding container 855d815d22495e18c1befba8c75560ae9983b8459aab715138cc70c8286b4581: Status 404 returned error can't find the container with id 855d815d22495e18c1befba8c75560ae9983b8459aab715138cc70c8286b4581
Oct 30 21:22:10.016827 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:10.016805    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5816f96_8b2e_4f04_a675_500b2a4044df.slice/crio-7f32e10773558ebef4e646177d54c856be053857aebd830aa040071602113175 WatchSource:0}: Error finding container 7f32e10773558ebef4e646177d54c856be053857aebd830aa040071602113175: Status 404 returned error can't find the container with id 7f32e10773558ebef4e646177d54c856be053857aebd830aa040071602113175
Oct 30 21:22:10.426726 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.426442    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:10.426726 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.426491    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:10.426726 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.426650    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:10.426726 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.426711    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs podName:b9c410c1-b967-4f7c-8478-ff14cd4696b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:12.426691698 +0000 UTC m=+5.268498771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs") pod "network-metrics-daemon-vps4x" (UID: "b9c410c1-b967-4f7c-8478-ff14cd4696b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:10.427116 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.426779    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:10.427116 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.426814    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret podName:a5515bc6-8312-4be8-999c-9072fa30b526 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:12.426803227 +0000 UTC m=+5.268610296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret") pod "global-pull-secret-syncer-s4z6n" (UID: "a5515bc6-8312-4be8-999c-9072fa30b526") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:10.527606 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.527563    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:10.528170 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.527783    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:22:10.528170 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.527803    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:22:10.528170 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.527817    2543 projected.go:196] Error preparing data for projected volume kube-api-access-jpjm4 for pod openshift-network-diagnostics/network-check-target-qm2pw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:10.528170 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.527873    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4 podName:0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f nodeName:}" failed. No retries permitted until 2026-10-30 21:22:12.527855835 +0000 UTC m=+5.369662894 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jpjm4" (UniqueName: "kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4") pod "network-check-target-qm2pw" (UID: "0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:10.640315 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.640272    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:10.640490 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.640428    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:10.640565 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.640513    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:10.640708 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.640678    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:10.640823 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.640808    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:10.640916 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:10.640897    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:10.662716 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.662685    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4gdh" event={"ID":"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2","Type":"ContainerStarted","Data":"855d815d22495e18c1befba8c75560ae9983b8459aab715138cc70c8286b4581"}
Oct 30 21:22:10.669106 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.669024    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn" event={"ID":"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534","Type":"ContainerStarted","Data":"74bc8edbf0633a2bb226c5ad5ecd03561b6ca4f84052268ddecbac6a9b3a93f4"}
Oct 30 21:22:10.672851 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.672799    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4p5ng" event={"ID":"a5816f96-8b2e-4f04-a675-500b2a4044df","Type":"ContainerStarted","Data":"7f32e10773558ebef4e646177d54c856be053857aebd830aa040071602113175"}
Oct 30 21:22:10.863894 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.863785    2543 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:17:09 +0000 UTC" deadline="2028-04-13 04:37:42.622900498 +0000 UTC"
Oct 30 21:22:10.863894 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:10.863848    2543 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12727h15m31.75905598s"
Oct 30 21:22:12.452845 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:12.452792    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:12.452845 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:12.452846    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:12.453414 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.453030    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:12.453414 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.453096    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs podName:b9c410c1-b967-4f7c-8478-ff14cd4696b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:16.453076234 +0000 UTC m=+9.294883293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs") pod "network-metrics-daemon-vps4x" (UID: "b9c410c1-b967-4f7c-8478-ff14cd4696b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:12.453414 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.453167    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:12.453414 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.453204    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret podName:a5515bc6-8312-4be8-999c-9072fa30b526 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:16.453191767 +0000 UTC m=+9.294998825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret") pod "global-pull-secret-syncer-s4z6n" (UID: "a5515bc6-8312-4be8-999c-9072fa30b526") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:12.554064 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:12.554026    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:12.554442 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.554238    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:22:12.554442 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.554261    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:22:12.554442 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.554276    2543 projected.go:196] Error preparing data for projected volume kube-api-access-jpjm4 for pod openshift-network-diagnostics/network-check-target-qm2pw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:12.554442 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.554332    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4 podName:0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f nodeName:}" failed. No retries permitted until 2026-10-30 21:22:16.554314512 +0000 UTC m=+9.396121569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jpjm4" (UniqueName: "kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4") pod "network-check-target-qm2pw" (UID: "0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:12.641297 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:12.641161    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:12.641476 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.641369    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:12.641548 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:12.641474    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:12.641604 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.641555    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:12.641604 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:12.641601    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:12.641744 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:12.641670    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:13.710518 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:13.709418    2543 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="f7164d5740674a5a51965d4f92d1f043698f1d46775877b50469fdfe193b9b83" exitCode=0
Oct 30 21:22:13.710518 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:13.709587    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" event={"ID":"7026bee2-54f0-43f2-aaeb-b7c81acd5e68","Type":"ContainerDied","Data":"f7164d5740674a5a51965d4f92d1f043698f1d46775877b50469fdfe193b9b83"}
Oct 30 21:22:14.641586 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:14.641128    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:14.641586 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:14.641259    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:14.641586 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:14.641332    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:14.641586 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:14.641388    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:14.641586 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:14.641450    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:14.641586 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:14.641539    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:14.715708 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:14.715627    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal" event={"ID":"318fdbac2e696c24464ab55f83e20597","Type":"ContainerStarted","Data":"85ba9ff0348d190e87ede0b8ed207de26a0d9d8b5d67aecb1652c655ed1fb764"}
Oct 30 21:22:14.719333 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:14.719301    2543 generic.go:356] "Generic (PLEG): container finished" podID="24abb3b3ef955062440aec6d22d39298" containerID="e26a0eb1d1e239ae891effdce39951ce909cc652f8c5b2d100cd1ed00db333c8" exitCode=0
Oct 30 21:22:14.719456 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:14.719358    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal" event={"ID":"24abb3b3ef955062440aec6d22d39298","Type":"ContainerDied","Data":"e26a0eb1d1e239ae891effdce39951ce909cc652f8c5b2d100cd1ed00db333c8"}
Oct 30 21:22:14.968086 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:14.967960    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal" podStartSLOduration=6.967940362 podStartE2EDuration="6.967940362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:14.842549954 +0000 UTC m=+7.684357032" watchObservedRunningTime="2026-10-30 21:22:14.967940362 +0000 UTC m=+7.809747441"
Oct 30 21:22:15.727841 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:15.727801    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal" event={"ID":"24abb3b3ef955062440aec6d22d39298","Type":"ContainerStarted","Data":"5952f6cf3e0d9276596070e3985d932a393b33e8263364814850e32230aa39ab"}
Oct 30 21:22:16.492440 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.492377    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:16.492440 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.492430    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:16.492686 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.492625    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:16.492749 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.492692    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs podName:b9c410c1-b967-4f7c-8478-ff14cd4696b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:24.492673476 +0000 UTC m=+17.334480544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs") pod "network-metrics-daemon-vps4x" (UID: "b9c410c1-b967-4f7c-8478-ff14cd4696b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:16.492819 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.492765    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:16.492819 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.492801    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret podName:a5515bc6-8312-4be8-999c-9072fa30b526 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:24.492789563 +0000 UTC m=+17.334596632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret") pod "global-pull-secret-syncer-s4z6n" (UID: "a5515bc6-8312-4be8-999c-9072fa30b526") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:16.593575 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.593531    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:16.593789 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.593767    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:22:16.593864 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.593802    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:22:16.593864 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.593816    2543 projected.go:196] Error preparing data for projected volume kube-api-access-jpjm4 for pod openshift-network-diagnostics/network-check-target-qm2pw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:16.593979 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.593874    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4 podName:0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f nodeName:}" failed. No retries permitted until 2026-10-30 21:22:24.59385498 +0000 UTC m=+17.435662053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jpjm4" (UniqueName: "kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4") pod "network-check-target-qm2pw" (UID: "0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:16.640923 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.640891    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:16.641133 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.641056    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:16.641133 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.641118    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:16.641253 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.641189    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:16.641253 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.641231    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:16.641362 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:16.641305    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:16.738946 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.738906    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4gdh" event={"ID":"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2","Type":"ContainerStarted","Data":"3cc1fb150e2bb94a62cd80ca301e02a83542e057ef065d27f0de4f548a8b9407"}
Oct 30 21:22:16.744133 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.744069    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5szpn" event={"ID":"7f630f6b-6df2-4c78-9aff-8f2577cfb56c","Type":"ContainerStarted","Data":"222477ff8b544a709321073f707f48efa7f90375525ae366a149fb5bf15e9158"}
Oct 30 21:22:16.875374 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.875311    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k4gdh" podStartSLOduration=2.658885371 podStartE2EDuration="8.875292789s" totalImagesPullingTime="6.216407418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:16.874521273 +0000 UTC m=+9.716328351" watchObservedRunningTime="2026-10-30 21:22:16.875292789 +0000 UTC m=+9.717099867"
Oct 30 21:22:16.876058 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:16.875894    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal" podStartSLOduration=8.875886829 podStartE2EDuration="8.875886829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:15.854232897 +0000 UTC m=+8.696040069" watchObservedRunningTime="2026-10-30 21:22:16.875886829 +0000 UTC m=+9.717693910"
Oct 30 21:22:17.338148 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:17.337863    2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:17.339272 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:17.339058    2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:17.471503 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:17.470865    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5szpn" podStartSLOduration=2.536437389 podStartE2EDuration="9.470841905s" totalImagesPullingTime="6.934404516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:17.001018465 +0000 UTC m=+9.842825573" watchObservedRunningTime="2026-10-30 21:22:17.470841905 +0000 UTC m=+10.312648959"
Oct 30 21:22:17.749378 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:17.749325    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn" event={"ID":"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534","Type":"ContainerStarted","Data":"f02e3e02c0517a0944081b066a5c389ef5d97585af90c012cb224872098a87de"}
Oct 30 21:22:18.641488 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:18.641232    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:18.641488 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:18.641359    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:18.641488 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:18.641436    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:18.641648 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:18.641524    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:18.641648 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:18.641577    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:18.641648 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:18.641642    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:18.760226 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:18.760155    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cgnp7" event={"ID":"2523fa7a-1747-4695-a737-5c2a1caf2864","Type":"ContainerStarted","Data":"bb0380a9e30c75cc982cf4909735802b475bbacb2ac72fcc45f98c4e347f8602"}
Oct 30 21:22:18.763996 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:18.763950    2543 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:22:18.764723 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:18.764700    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4p5ng" event={"ID":"a5816f96-8b2e-4f04-a675-500b2a4044df","Type":"ContainerStarted","Data":"09be276b468493a73d8325f1d914401afa35e2e58bfb3a63df568bcd1a3db2b4"}
Oct 30 21:22:18.877157 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:18.877104    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-cgnp7" podStartSLOduration=1.5909126850000002 podStartE2EDuration="10.877090208s" totalImagesPullingTime="9.286177523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:18.876909035 +0000 UTC m=+11.718716110" watchObservedRunningTime="2026-10-30 21:22:18.877090208 +0000 UTC m=+11.718897282"
Oct 30 21:22:19.095785 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.095744    2543 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:22:19.572003 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.571654    2543 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:22:19.095768405Z","UUID":"cd2bd122-7d3c-41b4-afb9-71a311a1e03a","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:22:19.573229 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.573206    2543 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:22:19.573352 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.573238    2543 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:22:19.769018 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.768924    2543 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="45cac35b323e28387430c5d868d938ba7e8f770f5756226e4b6fe06d38c9a1fa" exitCode=0
Oct 30 21:22:19.769396 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.769054    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" event={"ID":"7026bee2-54f0-43f2-aaeb-b7c81acd5e68","Type":"ContainerDied","Data":"45cac35b323e28387430c5d868d938ba7e8f770f5756226e4b6fe06d38c9a1fa"}
Oct 30 21:22:19.771698 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.771674    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn" event={"ID":"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534","Type":"ContainerStarted","Data":"2f9cd67d6739277304204788dcb0c26b18781a86650a760ce56ac3fef243e3cf"}
Oct 30 21:22:19.772102 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.772072    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:19.772194 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.772161    2543 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:22:19.773289 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.773198    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:22:19.891891 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:19.891836    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-4p5ng" podStartSLOduration=3.373973225 podStartE2EDuration="11.891819511s" totalImagesPullingTime="8.517846286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:18.996611937 +0000 UTC m=+11.838419012" watchObservedRunningTime="2026-10-30 21:22:19.891819511 +0000 UTC m=+12.733626588"
Oct 30 21:22:20.641129 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:20.641101    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:20.641303 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:20.641231    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:20.641594 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:20.641575    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:20.641699 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:20.641666    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:20.641767 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:20.641732    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:20.641817 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:20.641805    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:20.777586 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:20.777546    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-25zhv" event={"ID":"822b5a15-b6cd-4106-b4c7-76ae8d6db19a","Type":"ContainerStarted","Data":"daa3d1a7cbc0748a404535c87ac6646378ccf80d9c52e5899de88ea2a92b868b"}
Oct 30 21:22:20.897863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:20.897760    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-25zhv" podStartSLOduration=2.873582358 podStartE2EDuration="12.897741686s" totalImagesPullingTime="10.024159328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:20.896842214 +0000 UTC m=+13.738649287" watchObservedRunningTime="2026-10-30 21:22:20.897741686 +0000 UTC m=+13.739548762"
Oct 30 21:22:21.781397 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:21.781369    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" event={"ID":"7026bee2-54f0-43f2-aaeb-b7c81acd5e68","Type":"ContainerStarted","Data":"9d6b86789ac694bd57b499f52e86ae02c50696b52d7f78370787d16b68dc4399"}
Oct 30 21:22:21.782920 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:21.782897    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2gbd4" event={"ID":"204ffe78-eee5-4cf4-9eb3-23a4034a26af","Type":"ContainerStarted","Data":"8908667d67c15485c9bbc7b2d5efe70b8375f441b6721e1605164228541bdf42"}
Oct 30 21:22:21.785344 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:21.785321    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn" event={"ID":"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534","Type":"ContainerStarted","Data":"abe391d58d997546aa95dee6cdf61e95da70307f0e50f56746716f1c1bf5f6a4"}
Oct 30 21:22:22.242378 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:22.242325    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn" podStartSLOduration=3.317711976 podStartE2EDuration="14.242310322s" totalImagesPullingTime="10.924598346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:22.241651808 +0000 UTC m=+15.083458897" watchObservedRunningTime="2026-10-30 21:22:22.242310322 +0000 UTC m=+15.084117397"
Oct 30 21:22:22.242556 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:22.242441    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2gbd4" podStartSLOduration=1.811683692 podStartE2EDuration="14.242437506s" totalImagesPullingTime="12.430753814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:22.123042643 +0000 UTC m=+14.964849720" watchObservedRunningTime="2026-10-30 21:22:22.242437506 +0000 UTC m=+15.084244579"
Oct 30 21:22:22.640280 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:22.640253    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:22.640445 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:22.640348    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:22.640445 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:22.640369    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:22.640554 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:22.640463    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:22.640554 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:22.640531    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:22.640646 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:22.640625    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:22.790151 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:22.790121    2543 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="9d6b86789ac694bd57b499f52e86ae02c50696b52d7f78370787d16b68dc4399" exitCode=0
Oct 30 21:22:22.790641 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:22.790412    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" event={"ID":"7026bee2-54f0-43f2-aaeb-b7c81acd5e68","Type":"ContainerDied","Data":"9d6b86789ac694bd57b499f52e86ae02c50696b52d7f78370787d16b68dc4399"}
Oct 30 21:22:23.794979 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:23.794932    2543 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="bf6edd35c4cd57a9068fd6a6494d0c4f368c3178f7cf310a22f93960c59b652a" exitCode=0
Oct 30 21:22:23.795576 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:23.795012    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" event={"ID":"7026bee2-54f0-43f2-aaeb-b7c81acd5e68","Type":"ContainerDied","Data":"bf6edd35c4cd57a9068fd6a6494d0c4f368c3178f7cf310a22f93960c59b652a"}
Oct 30 21:22:24.554301 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:24.554092    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:24.554476 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:24.554317    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:24.554476 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.554241    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:24.554476 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.554428    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:24.554476 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.554435    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret podName:a5515bc6-8312-4be8-999c-9072fa30b526 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.554413841 +0000 UTC m=+33.396220901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret") pod "global-pull-secret-syncer-s4z6n" (UID: "a5515bc6-8312-4be8-999c-9072fa30b526") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:24.554476 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.554479    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs podName:b9c410c1-b967-4f7c-8478-ff14cd4696b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.554463466 +0000 UTC m=+33.396270541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs") pod "network-metrics-daemon-vps4x" (UID: "b9c410c1-b967-4f7c-8478-ff14cd4696b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:24.641210 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:24.641180    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:24.641362 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:24.641262    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:24.641362 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:24.641281    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:24.641443 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.641390    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:24.641482 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.641455    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:24.641558 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.641537    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:24.655387 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:24.655359    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:24.655546 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.655530    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:22:24.655591 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.655556    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:22:24.655591 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.655568    2543 projected.go:196] Error preparing data for projected volume kube-api-access-jpjm4 for pod openshift-network-diagnostics/network-check-target-qm2pw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:24.655651 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:24.655605    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4 podName:0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.655593961 +0000 UTC m=+33.497401012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jpjm4" (UniqueName: "kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4") pod "network-check-target-qm2pw" (UID: "0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:22:25.802942 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:25.802763    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" event={"ID":"b5fef5d7-aeae-4377-b42a-18ca1db1aef4","Type":"ContainerStarted","Data":"05188be228832cad6486b133cd5a73ab1c9d771342e1a808edc4a4616bed0f5c"}
Oct 30 21:22:25.803291 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:25.803031    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" event={"ID":"b5fef5d7-aeae-4377-b42a-18ca1db1aef4","Type":"ContainerStarted","Data":"7638f8d971382155e8d66b59ef7fde70ed5a46b560d436e08938ebc1b8431e3f"}
Oct 30 21:22:25.803291 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:25.803095    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" event={"ID":"b5fef5d7-aeae-4377-b42a-18ca1db1aef4","Type":"ContainerStarted","Data":"5efbde852b0e0b5c8c07cb8a3fd05d7b30fada21a6aa86b8299c91ea3d39a2c9"}
Oct 30 21:22:25.803291 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:25.803142    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" event={"ID":"b5fef5d7-aeae-4377-b42a-18ca1db1aef4","Type":"ContainerStarted","Data":"d76b76cd5b628df5272d05ee4768dcfe884f0910b69ace5650e175eca82cd7be"}
Oct 30 21:22:26.640326 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:26.640302    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:26.640496 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:26.640303    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:26.640496 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:26.640397    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:26.640496 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:26.640310    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:26.640496 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:26.640465    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:26.640623 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:26.640524    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:26.809651 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:26.809617    2543 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="80fdf3b91b30787c45cc4a099296ea9b9fdbf3d3769547db1b30a8f63c3aada5" exitCode=0
Oct 30 21:22:26.810223 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:26.809692    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" event={"ID":"7026bee2-54f0-43f2-aaeb-b7c81acd5e68","Type":"ContainerDied","Data":"80fdf3b91b30787c45cc4a099296ea9b9fdbf3d3769547db1b30a8f63c3aada5"}
Oct 30 21:22:26.812795 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:26.812771    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" event={"ID":"b5fef5d7-aeae-4377-b42a-18ca1db1aef4","Type":"ContainerStarted","Data":"ee0e122fa5a5e7b5f233c8f4287d59ca5202f9abf7239925be779922948adaca"}
Oct 30 21:22:26.812881 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:26.812825    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" event={"ID":"b5fef5d7-aeae-4377-b42a-18ca1db1aef4","Type":"ContainerStarted","Data":"40a2edc06160cfafb48b3220572d20022cf49019c1442e1d6245ac8bd2f2e5ca"}
Oct 30 21:22:27.817400 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:27.817375    2543 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="48207779bcc7cf54bc1e5f46a9a3dd6ba77a55caf215bb75829e9d8c049ebf57" exitCode=0
Oct 30 21:22:27.817808 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:27.817426    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" event={"ID":"7026bee2-54f0-43f2-aaeb-b7c81acd5e68","Type":"ContainerDied","Data":"48207779bcc7cf54bc1e5f46a9a3dd6ba77a55caf215bb75829e9d8c049ebf57"}
Oct 30 21:22:28.640668 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:28.640630    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:28.640668 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:28.640656    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:28.640847 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:28.640750    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:28.640847 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:28.640796    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:28.640903 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:28.640885    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:28.640954 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:28.640939    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:28.824946 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:28.824911    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" event={"ID":"7026bee2-54f0-43f2-aaeb-b7c81acd5e68","Type":"ContainerStarted","Data":"71848607a2a809af93545dca831aa16868fb21f1e18b1cd546f2ad908f39cc27"}
Oct 30 21:22:28.828081 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:28.828058    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" event={"ID":"b5fef5d7-aeae-4377-b42a-18ca1db1aef4","Type":"ContainerStarted","Data":"8de10dc135b99c39bd2d70c81bc67cd6453820e0e3bafb71a43a5e0b72f58e4c"}
Oct 30 21:22:28.950540 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:28.950467    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k4wl2" podStartSLOduration=7.364389871 podStartE2EDuration="20.950455737s" totalImagesPullingTime="13.586065866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:28.950050894 +0000 UTC m=+21.791857970" watchObservedRunningTime="2026-10-30 21:22:28.950455737 +0000 UTC m=+21.792262810"
Oct 30 21:22:30.641223 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:30.641190    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:30.641223 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:30.641207    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:30.641919 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:30.641200    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:30.641919 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:30.641308    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:30.641919 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:30.641368    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:30.641919 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:30.641485    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:30.835178 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:30.834997    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" event={"ID":"b5fef5d7-aeae-4377-b42a-18ca1db1aef4","Type":"ContainerStarted","Data":"f9e85d1e7c430d2f459f9fbd8677aa33df3212e66af200d8f7662437cb29790e"}
Oct 30 21:22:30.835335 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:30.835236    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:30.850645 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:30.850625    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:31.113458 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:31.113355    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4" podStartSLOduration=6.747647748 podStartE2EDuration="23.113344803s" totalImagesPullingTime="16.365697055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:31.113120633 +0000 UTC m=+23.954927707" watchObservedRunningTime="2026-10-30 21:22:31.113344803 +0000 UTC m=+23.955151877"
Oct 30 21:22:31.837654 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:31.837625    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:31.838029 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:31.837687    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:31.852746 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:31.852720    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:22:32.641046 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:32.641005    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:32.641046 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:32.641041    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:32.641227 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:32.641005    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:32.641227 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:32.641126    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:32.641227 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:32.641196    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:32.641320 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:32.641263    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:32.662443 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:32.662418    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4z6n"]
Oct 30 21:22:32.665248 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:32.665218    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vps4x"]
Oct 30 21:22:32.665820 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:32.665800    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm2pw"]
Oct 30 21:22:32.839001 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:32.838951    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:32.839001 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:32.838988    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:32.839001 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:32.838951    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:32.839396 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:32.839100    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:32.839396 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:32.839177    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:32.839528 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:32.839510    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:34.640198 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:34.640169    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:34.640198 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:34.640189    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:34.640626 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:34.640268    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:34.640626 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:34.640289    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:34.640626 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:34.640343    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:34.640626 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:34.640394    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:36.640925 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:36.640896    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:36.640925 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:36.640932    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:36.641355 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:36.640927    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:36.641355 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:36.641028    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:36.641355 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:36.641143    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:36.641355 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:36.641208    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:38.640897 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.640871    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:38.641304 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.640873    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:38.641304 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.640878    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:38.641304 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:38.641088    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4z6n" podUID="a5515bc6-8312-4be8-999c-9072fa30b526"
Oct 30 21:22:38.641304 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:38.640958    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm2pw" podUID="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f"
Oct 30 21:22:38.641304 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:38.641147    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vps4x" podUID="b9c410c1-b967-4f7c-8478-ff14cd4696b3"
Oct 30 21:22:38.835478 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.835345    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:22:38.835619 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.835555    2543 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 21:22:38.921729 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.921668    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7xpgb"]
Oct 30 21:22:38.924481 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.924456    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-7xpgb"
Oct 30 21:22:38.940809 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.940789    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-s5j2v"]
Oct 30 21:22:38.943467 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.943455    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-s5j2v"
Oct 30 21:22:38.950429 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.950413    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-h6pc5"]
Oct 30 21:22:38.953730 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.953716    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-xc5td"]
Oct 30 21:22:38.953858 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.953841    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-h6pc5"
Oct 30 21:22:38.956418 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.956399    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"]
Oct 30 21:22:38.956522 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.956496    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:38.959095 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.959080    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-2thg2"]
Oct 30 21:22:38.959203 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.959188    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:38.962050 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.962033    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66bc45fc97-b8kwb"]
Oct 30 21:22:38.962168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.962151    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:38.965043 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.965026    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"]
Oct 30 21:22:38.965130 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.965114    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:38.968112 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.968096    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"]
Oct 30 21:22:38.968217 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.968202    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:38.970825 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.970811    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"]
Oct 30 21:22:38.970930 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.970915    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"
Oct 30 21:22:38.973708 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.973691    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"]
Oct 30 21:22:38.973818 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.973804    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:38.977426 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.977394    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:38.977897 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.977880    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 21:22:38.978004 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:38.977987    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.013208 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.013165    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 21:22:39.013359 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.013342    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 21:22:39.013412 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.013361    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-5nb2r\""
Oct 30 21:22:39.015133 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.015114    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 21:22:39.032432 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.032409    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"]
Oct 30 21:22:39.035438 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.035415    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"]
Oct 30 21:22:39.035560 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.035543    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.038219 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.038203    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7659844d84-4hwr6"]
Oct 30 21:22:39.038365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.038347    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"
Oct 30 21:22:39.041131 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.041113    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b884d7489-6cmkh"]
Oct 30 21:22:39.041228 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.041214    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.044046 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.044030    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7xpgb"]
Oct 30 21:22:39.044117 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.044055    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-s5j2v"]
Oct 30 21:22:39.044117 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.044072    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-h6pc5"]
Oct 30 21:22:39.044117 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.044091    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-xc5td"]
Oct 30 21:22:39.044117 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.044113    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-2thg2"]
Oct 30 21:22:39.044269 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.044130    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"]
Oct 30 21:22:39.044269 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.044135    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.044269 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.044150    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66bc45fc97-b8kwb"]
Oct 30 21:22:39.044269 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.044171    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g8nnl"]
Oct 30 21:22:39.046942 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.046926    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:22:39.047204 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.047185    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7fr7k"]
Oct 30 21:22:39.050275 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.050257    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.051092 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.051073    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"]
Oct 30 21:22:39.062779 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.062758    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjzq2\" (UniqueName: \"kubernetes.io/projected/32575811-fcf4-4bcd-beb3-6bc4f0d472bd-kube-api-access-wjzq2\") pod \"kas-connection-checker-685895c7c9-s5j2v\" (UID: \"32575811-fcf4-4bcd-beb3-6bc4f0d472bd\") " pod="kube-system/kas-connection-checker-685895c7c9-s5j2v"
Oct 30 21:22:39.062859 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.062796    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39c99098-aa34-4200-b2a4-2404ae1cd454-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.062859 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.062830    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ade972d-dd5c-4128-bdd8-98647d69d3a8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:39.062927 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.062864    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsvhv\" (UniqueName: \"kubernetes.io/projected/39c99098-aa34-4200-b2a4-2404ae1cd454-kube-api-access-gsvhv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.062927 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.062902    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.063018 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.062949    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-stats-auth\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.063060 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063044    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-config\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.063092 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063078    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8l2r\" (UniqueName: \"kubernetes.io/projected/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-kube-api-access-t8l2r\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.063123 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063104    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-default-certificate\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.063160 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063128    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.063193 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063155    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-tmp\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.063231 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063195    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-snapshots\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.063312 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063295    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:39.063355 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063328    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-service-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.063399 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063373    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74l2w\" (UniqueName: \"kubernetes.io/projected/7735f8ec-f901-4584-b995-6f5b4bb14a79-kube-api-access-74l2w\") pod \"kas-connection-checker-685895c7c9-7xpgb\" (UID: \"7735f8ec-f901-4584-b995-6f5b4bb14a79\") " pod="kube-system/kas-connection-checker-685895c7c9-7xpgb"
Oct 30 21:22:39.063441 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063410    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:39.063507 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063486    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.063603 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063517    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.063603 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063562    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwb8w\" (UniqueName: \"kubernetes.io/projected/a0747bf5-ca98-4d2c-9723-3c226817ee66-kube-api-access-vwb8w\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:39.063603 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063599    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-serving-cert\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.063760 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063615    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:39.063760 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063633    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlqdc\" (UniqueName: \"kubernetes.io/projected/e7b27302-be59-4dc9-8e64-0ea2b2f4baa2-kube-api-access-wlqdc\") pod \"kas-connection-checker-685895c7c9-h6pc5\" (UID: \"e7b27302-be59-4dc9-8e64-0ea2b2f4baa2\") " pod="kube-system/kas-connection-checker-685895c7c9-h6pc5"
Oct 30 21:22:39.063760 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063651    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:39.063760 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063700    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39c99098-aa34-4200-b2a4-2404ae1cd454-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.063952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063768    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mszds\" (UniqueName: \"kubernetes.io/projected/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-kube-api-access-mszds\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.063952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063796    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f7qj\" (UniqueName: \"kubernetes.io/projected/a5d11da4-5f47-4bba-bc30-54df80304964-kube-api-access-9f7qj\") pod \"volume-data-source-validator-58c9f5f46d-dz9pg\" (UID: \"a5d11da4-5f47-4bba-bc30-54df80304964\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"
Oct 30 21:22:39.063952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063849    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvqhl\" (UniqueName: \"kubernetes.io/projected/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-kube-api-access-tvqhl\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:39.063952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063866    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4qvr\" (UniqueName: \"kubernetes.io/projected/0dae4f31-8ea9-480a-881f-61bad1def6bc-kube-api-access-h4qvr\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.063952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063906    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-serving-cert\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.063952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.063939    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:39.077762 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.077745    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"]
Oct 30 21:22:39.081413 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.081392    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.081754 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.081721    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.088342 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.088312    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 21:22:39.088342 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.088343    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.088642 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.088629    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.090725 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.090710    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 21:22:39.091008 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.090994    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.091248 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.091237    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 21:22:39.097197 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.097178    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.132262 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.132237    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.132365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.132312    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.134441 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.134425    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.135859 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.135843    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:22:39.135920 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.135897    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.136365    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.136536    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.136579    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.136866    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.136998    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.137168    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.137375    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.137421    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.137431    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.137608    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.137720    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.137866    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.138009    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.138675    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.138713    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.138795    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:22:39.139365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.138900    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:22:39.140366 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.140343    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"]
Oct 30 21:22:39.141537 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.141516    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"]
Oct 30 21:22:39.147260 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.147237    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 21:22:39.147364 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.147304    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:22:39.148025 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.148005    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"]
Oct 30 21:22:39.151124 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151105    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 21:22:39.151621 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151600    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151633    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151639    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151656    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151679    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151683    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151695    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151639    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151712    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjpnc\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151797    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151820    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pdhmp\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151854    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 21:22:39.152209 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.151934    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-wjtfq\""
Oct 30 21:22:39.153029 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.153011    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"]
Oct 30 21:22:39.154011 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.153994    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b884d7489-6cmkh"]
Oct 30 21:22:39.154894 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.154876    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7fr7k"]
Oct 30 21:22:39.155547 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.155531    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7659844d84-4hwr6"]
Oct 30 21:22:39.165064 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165042    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-serving-cert\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.165154 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165078    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.165154 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165103    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.165228 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165177    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:39.165228 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165202    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.165228 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165223    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqdc\" (UniqueName: \"kubernetes.io/projected/e7b27302-be59-4dc9-8e64-0ea2b2f4baa2-kube-api-access-wlqdc\") pod \"kas-connection-checker-685895c7c9-h6pc5\" (UID: \"e7b27302-be59-4dc9-8e64-0ea2b2f4baa2\") " pod="kube-system/kas-connection-checker-685895c7c9-h6pc5"
Oct 30 21:22:39.165353 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165242    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4cxm\" (UniqueName: \"kubernetes.io/projected/1737ddb3-e512-4944-8aad-94fac75a3a7e-kube-api-access-d4cxm\") pod \"network-check-source-6f78d59f99-948s6\" (UID: \"1737ddb3-e512-4944-8aad-94fac75a3a7e\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"
Oct 30 21:22:39.165353 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165257    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-installation-pull-secrets\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.165353 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165308    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.165353 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.165327    2543 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:22:39.165543 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.165410    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert podName:7ade972d-dd5c-4128-bdd8-98647d69d3a8 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:39.665394987 +0000 UTC m=+32.507202063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xc5td" (UID: "7ade972d-dd5c-4128-bdd8-98647d69d3a8") : secret "networking-console-plugin-cert" not found
Oct 30 21:22:39.165543 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165426    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:39.165543 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165445    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39c99098-aa34-4200-b2a4-2404ae1cd454-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.165543 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165463    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9de1fa-933d-49a5-84ed-2418c40eead3-cert\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:22:39.165543 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165479    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mszds\" (UniqueName: \"kubernetes.io/projected/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-kube-api-access-mszds\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.165543 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165501    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7qj\" (UniqueName: \"kubernetes.io/projected/a5d11da4-5f47-4bba-bc30-54df80304964-kube-api-access-9f7qj\") pod \"volume-data-source-validator-58c9f5f46d-dz9pg\" (UID: \"a5d11da4-5f47-4bba-bc30-54df80304964\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"
Oct 30 21:22:39.165543 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165533    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvqhl\" (UniqueName: \"kubernetes.io/projected/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-kube-api-access-tvqhl\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165558    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4qvr\" (UniqueName: \"kubernetes.io/projected/0dae4f31-8ea9-480a-881f-61bad1def6bc-kube-api-access-h4qvr\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.165589    2543 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.165639    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls podName:a0747bf5-ca98-4d2c-9723-3c226817ee66 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:39.665623667 +0000 UTC m=+32.507430733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-57r7x" (UID: "a0747bf5-ca98-4d2c-9723-3c226817ee66") : secret "samples-operator-tls" not found
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165693    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-serving-cert\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165730    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-registry-certificates\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165758    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165809    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.165830    2543 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165854    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjzq2\" (UniqueName: \"kubernetes.io/projected/32575811-fcf4-4bcd-beb3-6bc4f0d472bd-kube-api-access-wjzq2\") pod \"kas-connection-checker-685895c7c9-s5j2v\" (UID: \"32575811-fcf4-4bcd-beb3-6bc4f0d472bd\") " pod="kube-system/kas-connection-checker-685895c7c9-s5j2v"
Oct 30 21:22:39.165883 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.165876    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls podName:f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb nodeName:}" failed. No retries permitted until 2026-10-30 21:22:39.665861546 +0000 UTC m=+32.507668612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fwxj8" (UID: "f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165902    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39c99098-aa34-4200-b2a4-2404ae1cd454-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165932    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ade972d-dd5c-4128-bdd8-98647d69d3a8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.165958    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsvhv\" (UniqueName: \"kubernetes.io/projected/39c99098-aa34-4200-b2a4-2404ae1cd454-kube-api-access-gsvhv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166017    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166046    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf2dx\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166071    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166099    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw2bl\" (UniqueName: \"kubernetes.io/projected/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-kube-api-access-hw2bl\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166125    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-stats-auth\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.166151    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:39.666134809 +0000 UTC m=+32.507941887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : configmap references non-existent config key: service-ca.crt
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166191    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-config\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.166390 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166222    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8l2r\" (UniqueName: \"kubernetes.io/projected/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-kube-api-access-t8l2r\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.166855 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166608    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-default-certificate\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.166855 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166643    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.166855 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166671    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.166855 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166699    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-tmp\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.166855 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166708    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39c99098-aa34-4200-b2a4-2404ae1cd454-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.166855 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166716    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ade972d-dd5c-4128-bdd8-98647d69d3a8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:39.166855 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166723    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-snapshots\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.166855 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166795    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-serving-cert\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.166855 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166844    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-config\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.166862    2543 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166886    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.166900    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:39.666887579 +0000 UTC m=+32.508694655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : secret "router-metrics-certs-default" not found
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.166925    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-bound-sa-token\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167011    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-config-volume\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167069    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqls\" (UniqueName: \"kubernetes.io/projected/eb9de1fa-933d-49a5-84ed-2418c40eead3-kube-api-access-6lqls\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167112    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167158    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-trusted-ca\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167184    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-tmp-dir\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167224    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:39.167241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167239    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-tmp\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167254    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-service-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167289    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/128967db-384e-471a-83f9-aff67d93c9cf-ca-trust-extracted\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167315    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-snapshots\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167353    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74l2w\" (UniqueName: \"kubernetes.io/projected/7735f8ec-f901-4584-b995-6f5b4bb14a79-kube-api-access-74l2w\") pod \"kas-connection-checker-685895c7c9-7xpgb\" (UID: \"7735f8ec-f901-4584-b995-6f5b4bb14a79\") " pod="kube-system/kas-connection-checker-685895c7c9-7xpgb"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167380    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-config\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167500    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-image-registry-private-configuration\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167534    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167706    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-service-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167791    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.167887 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.167830    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.168420 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.168305    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:39.168702 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.168498    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:39.168777 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.168699    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwb8w\" (UniqueName: \"kubernetes.io/projected/a0747bf5-ca98-4d2c-9723-3c226817ee66-kube-api-access-vwb8w\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:39.168777 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.168743    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4q8k\" (UniqueName: \"kubernetes.io/projected/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-kube-api-access-r4q8k\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.168777 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.168768    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vpbb\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-kube-api-access-4vpbb\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.169195 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.169172    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.169646 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.169626    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.170248 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.170224    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39c99098-aa34-4200-b2a4-2404ae1cd454-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.170329 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.170263    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-serving-cert\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.170517 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.170498    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-stats-auth\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.170517 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.170511    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-default-certificate\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.170749 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.170728    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-serving-cert\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.184483 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.184437    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g8nnl"]
Oct 30 21:22:39.231486 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.231464    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlqdc\" (UniqueName: \"kubernetes.io/projected/e7b27302-be59-4dc9-8e64-0ea2b2f4baa2-kube-api-access-wlqdc\") pod \"kas-connection-checker-685895c7c9-h6pc5\" (UID: \"e7b27302-be59-4dc9-8e64-0ea2b2f4baa2\") " pod="kube-system/kas-connection-checker-685895c7c9-h6pc5"
Oct 30 21:22:39.234811 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.234789    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74l2w\" (UniqueName: \"kubernetes.io/projected/7735f8ec-f901-4584-b995-6f5b4bb14a79-kube-api-access-74l2w\") pod \"kas-connection-checker-685895c7c9-7xpgb\" (UID: \"7735f8ec-f901-4584-b995-6f5b4bb14a79\") " pod="kube-system/kas-connection-checker-685895c7c9-7xpgb"
Oct 30 21:22:39.235960 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.235939    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-7xpgb"
Oct 30 21:22:39.237531 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.237503    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjzq2\" (UniqueName: \"kubernetes.io/projected/32575811-fcf4-4bcd-beb3-6bc4f0d472bd-kube-api-access-wjzq2\") pod \"kas-connection-checker-685895c7c9-s5j2v\" (UID: \"32575811-fcf4-4bcd-beb3-6bc4f0d472bd\") " pod="kube-system/kas-connection-checker-685895c7c9-s5j2v"
Oct 30 21:22:39.237688 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.237657    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mszds\" (UniqueName: \"kubernetes.io/projected/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-kube-api-access-mszds\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.237688 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.237682    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f7qj\" (UniqueName: \"kubernetes.io/projected/a5d11da4-5f47-4bba-bc30-54df80304964-kube-api-access-9f7qj\") pod \"volume-data-source-validator-58c9f5f46d-dz9pg\" (UID: \"a5d11da4-5f47-4bba-bc30-54df80304964\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"
Oct 30 21:22:39.240376 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.240359    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8l2r\" (UniqueName: \"kubernetes.io/projected/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-kube-api-access-t8l2r\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.242789 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.242767    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwb8w\" (UniqueName: \"kubernetes.io/projected/a0747bf5-ca98-4d2c-9723-3c226817ee66-kube-api-access-vwb8w\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:39.242936 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.242854    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4qvr\" (UniqueName: \"kubernetes.io/projected/0dae4f31-8ea9-480a-881f-61bad1def6bc-kube-api-access-h4qvr\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.243337 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.243315    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsvhv\" (UniqueName: \"kubernetes.io/projected/39c99098-aa34-4200-b2a4-2404ae1cd454-kube-api-access-gsvhv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.245846 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.245779    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvqhl\" (UniqueName: \"kubernetes.io/projected/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-kube-api-access-tvqhl\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:39.253482 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.253466    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-s5j2v"
Oct 30 21:22:39.264842 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.264819    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-h6pc5"
Oct 30 21:22:39.270276 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270245    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.270371 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270294    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.270371 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270334    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.270371 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270363    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4cxm\" (UniqueName: \"kubernetes.io/projected/1737ddb3-e512-4944-8aad-94fac75a3a7e-kube-api-access-d4cxm\") pod \"network-check-source-6f78d59f99-948s6\" (UID: \"1737ddb3-e512-4944-8aad-94fac75a3a7e\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"
Oct 30 21:22:39.270535 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270386    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-installation-pull-secrets\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.270535 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270410    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.270535 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270448    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9de1fa-933d-49a5-84ed-2418c40eead3-cert\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:22:39.270535 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270478    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-registry-certificates\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.270535 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270510    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.270776 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270555    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf2dx\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.270776 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270579    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.270776 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270598    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw2bl\" (UniqueName: \"kubernetes.io/projected/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-kube-api-access-hw2bl\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.270776 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270638    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.270776 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270666    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-serving-cert\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.270776 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270693    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.271073 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.270984    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-bound-sa-token\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.271073 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271018    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-config-volume\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.271073 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271045    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqls\" (UniqueName: \"kubernetes.io/projected/eb9de1fa-933d-49a5-84ed-2418c40eead3-kube-api-access-6lqls\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:22:39.271263 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271070    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.271263 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271109    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-trusted-ca\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.271263 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271132    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-tmp-dir\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.271263 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271171    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/128967db-384e-471a-83f9-aff67d93c9cf-ca-trust-extracted\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.271263 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271222    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-config\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.271263 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271249    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-image-registry-private-configuration\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.271547 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271290    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4q8k\" (UniqueName: \"kubernetes.io/projected/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-kube-api-access-r4q8k\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.271547 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.271314    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vpbb\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-kube-api-access-4vpbb\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.271918 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.271869    2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:22:39.272036 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.271945    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls podName:df296dbb-fcbc-44be-ac0d-9dc2c84481cc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:39.771927424 +0000 UTC m=+32.613734478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls") pod "dns-default-7fr7k" (UID: "df296dbb-fcbc-44be-ac0d-9dc2c84481cc") : secret "dns-default-metrics-tls" not found
Oct 30 21:22:39.272154 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.272130    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.272315 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.272242    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:39.272315 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.272272    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7659844d84-4hwr6: secret "image-registry-tls" not found
Oct 30 21:22:39.272422 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.272319    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls podName:8ecfcbcb-28ea-40cf-825b-5b01330c18e9 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:39.772303934 +0000 UTC m=+32.614110990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls") pod "image-registry-7659844d84-4hwr6" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9") : secret "image-registry-tls" not found
Oct 30 21:22:39.272674 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.272654    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.273514 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.273497    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-registry-certificates\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.273747 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.273721    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:39.273747 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.273740    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b884d7489-6cmkh: secret "image-registry-tls" not found
Oct 30 21:22:39.273876 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.273763    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.273876 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.273780    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls podName:128967db-384e-471a-83f9-aff67d93c9cf nodeName:}" failed. No retries permitted until 2026-10-30 21:22:39.773769901 +0000 UTC m=+32.615576953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls") pod "image-registry-b884d7489-6cmkh" (UID: "128967db-384e-471a-83f9-aff67d93c9cf") : secret "image-registry-tls" not found
Oct 30 21:22:39.274340 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.274317    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-config-volume\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.274830 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.274807    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/128967db-384e-471a-83f9-aff67d93c9cf-ca-trust-extracted\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.275663 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.275631    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9de1fa-933d-49a5-84ed-2418c40eead3-cert\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:22:39.275913 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.275892    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-trusted-ca\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.276025 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.275918    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.276170 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.276147    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-tmp-dir\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.276326 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.276292    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-serving-cert\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.276513 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.276494    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-config\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.278601 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.278567    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-image-registry-private-configuration\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.279062 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.278787    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.279062 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.279021    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-installation-pull-secrets\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.283896 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.283085    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:22:39.302178 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.301814    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"
Oct 30 21:22:39.307285 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.307074    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:22:39.320073 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.317630    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:39.362648 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.362413    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:39.370052 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.369631    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqls\" (UniqueName: \"kubernetes.io/projected/eb9de1fa-933d-49a5-84ed-2418c40eead3-kube-api-access-6lqls\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:22:39.370052 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.369864    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4cxm\" (UniqueName: \"kubernetes.io/projected/1737ddb3-e512-4944-8aad-94fac75a3a7e-kube-api-access-d4cxm\") pod \"network-check-source-6f78d59f99-948s6\" (UID: \"1737ddb3-e512-4944-8aad-94fac75a3a7e\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"
Oct 30 21:22:39.370483 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.370429    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vpbb\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-kube-api-access-4vpbb\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.374908 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.374728    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:22:39.378917 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.378615    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw2bl\" (UniqueName: \"kubernetes.io/projected/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-kube-api-access-hw2bl\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.378917 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.378858    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4q8k\" (UniqueName: \"kubernetes.io/projected/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-kube-api-access-r4q8k\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.387305 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.380160    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.387305 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.384381    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-bound-sa-token\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.387305 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.385201    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf2dx\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.579171 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.579140    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:39.648934 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.648913    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:22:39.654624 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.654607    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"
Oct 30 21:22:39.665518 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.665479    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7xpgb"]
Oct 30 21:22:39.669744 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.669722    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-s5j2v"]
Oct 30 21:22:39.674895 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:39.674838    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32575811_fcf4_4bcd_beb3_6bc4f0d472bd.slice/crio-833dab624c0785600333f95b5d4a9914e1bb57e7c6226232b25aea6390bb0bcd WatchSource:0}: Error finding container 833dab624c0785600333f95b5d4a9914e1bb57e7c6226232b25aea6390bb0bcd: Status 404 returned error can't find the container with id 833dab624c0785600333f95b5d4a9914e1bb57e7c6226232b25aea6390bb0bcd
Oct 30 21:22:39.676730 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.676713    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:39.676866 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.676850    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:39.677006 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.676901    2543 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:22:39.677095 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.677079    2543 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:22:39.677153 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.677137    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls podName:a0747bf5-ca98-4d2c-9723-3c226817ee66 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.677119093 +0000 UTC m=+33.518926162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-57r7x" (UID: "a0747bf5-ca98-4d2c-9723-3c226817ee66") : secret "samples-operator-tls" not found
Oct 30 21:22:39.677199 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.677165    2543 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:39.677238 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.677208    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert podName:7ade972d-dd5c-4128-bdd8-98647d69d3a8 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.677185949 +0000 UTC m=+33.518993000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xc5td" (UID: "7ade972d-dd5c-4128-bdd8-98647d69d3a8") : secret "networking-console-plugin-cert" not found
Oct 30 21:22:39.677238 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.677230    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls podName:f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.677220766 +0000 UTC m=+33.519027823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fwxj8" (UID: "f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:39.677340 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.677087    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:39.677445 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.677369    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.677445 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.677411    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:39.677612 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.677512    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.677496371 +0000 UTC m=+33.519303437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : configmap references non-existent config key: service-ca.crt
Oct 30 21:22:39.677612 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.677569    2543 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:22:39.677723 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.677618    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.677606766 +0000 UTC m=+33.519413838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : secret "router-metrics-certs-default" not found
Oct 30 21:22:39.684781 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.684747    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-h6pc5"]
Oct 30 21:22:39.736768 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.736610    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-2thg2"]
Oct 30 21:22:39.744893 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.744861    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"]
Oct 30 21:22:39.755651 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.755591    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"]
Oct 30 21:22:39.755651 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.755638    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"]
Oct 30 21:22:39.757054 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:39.755977    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb22bba6_c4a6_4ff0_8c60_60f0c4e61864.slice/crio-08135341690f79cf38e4a486c8719672f762267b9f9635a765706e16f1685f0a WatchSource:0}: Error finding container 08135341690f79cf38e4a486c8719672f762267b9f9635a765706e16f1685f0a: Status 404 returned error can't find the container with id 08135341690f79cf38e4a486c8719672f762267b9f9635a765706e16f1685f0a
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.778530    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.778583    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.778739    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.778760    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7659844d84-4hwr6: secret "image-registry-tls" not found
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.778787    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.778804    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b884d7489-6cmkh: secret "image-registry-tls" not found
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.778823    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.778841    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls podName:8ecfcbcb-28ea-40cf-825b-5b01330c18e9 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.778818156 +0000 UTC m=+33.620625223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls") pod "image-registry-7659844d84-4hwr6" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9") : secret "image-registry-tls" not found
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.778876    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls podName:128967db-384e-471a-83f9-aff67d93c9cf nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.778856683 +0000 UTC m=+33.620663740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls") pod "image-registry-b884d7489-6cmkh" (UID: "128967db-384e-471a-83f9-aff67d93c9cf") : secret "image-registry-tls" not found
Oct 30 21:22:39.779094 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.778910    2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:22:39.779669 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:39.779647    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls podName:df296dbb-fcbc-44be-ac0d-9dc2c84481cc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:40.778949858 +0000 UTC m=+33.620756930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls") pod "dns-default-7fr7k" (UID: "df296dbb-fcbc-44be-ac0d-9dc2c84481cc") : secret "dns-default-metrics-tls" not found
Oct 30 21:22:39.787753 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.786354    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g8nnl"]
Oct 30 21:22:39.792116 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:39.792083    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9de1fa_933d_49a5_84ed_2418c40eead3.slice/crio-6f2a54f91e38ab7a6bd32cf9bd4d5451c3cf76dc353b45fd7184a957e7f4b55a WatchSource:0}: Error finding container 6f2a54f91e38ab7a6bd32cf9bd4d5451c3cf76dc353b45fd7184a957e7f4b55a: Status 404 returned error can't find the container with id 6f2a54f91e38ab7a6bd32cf9bd4d5451c3cf76dc353b45fd7184a957e7f4b55a
Oct 30 21:22:39.854504 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.854478    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m" event={"ID":"39c99098-aa34-4200-b2a4-2404ae1cd454","Type":"ContainerStarted","Data":"9198c4bb29241f690e2e12c5f7b8555d0fedfc6399c756b2609919ffb2b600fd"}
Oct 30 21:22:39.855556 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.855532    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g8nnl" event={"ID":"eb9de1fa-933d-49a5-84ed-2418c40eead3","Type":"ContainerStarted","Data":"6f2a54f91e38ab7a6bd32cf9bd4d5451c3cf76dc353b45fd7184a957e7f4b55a"}
Oct 30 21:22:39.856762 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.856709    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" event={"ID":"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387","Type":"ContainerStarted","Data":"1ebd0b165e2c9e9b195e597b658e48acc61a0abfa9e1036b0c521e6b08bb58c6"}
Oct 30 21:22:39.858371 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.858349    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-s5j2v" event={"ID":"32575811-fcf4-4bcd-beb3-6bc4f0d472bd","Type":"ContainerStarted","Data":"4c03ef76704e3a485f84f78972ae2404eb9d077ad70d5ece9a91d4e2b0701905"}
Oct 30 21:22:39.858693 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.858673    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-s5j2v" event={"ID":"32575811-fcf4-4bcd-beb3-6bc4f0d472bd","Type":"ContainerStarted","Data":"833dab624c0785600333f95b5d4a9914e1bb57e7c6226232b25aea6390bb0bcd"}
Oct 30 21:22:39.860608 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.860590    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-7xpgb" event={"ID":"7735f8ec-f901-4584-b995-6f5b4bb14a79","Type":"ContainerStarted","Data":"f4afa9f0387fb27b0a7ce6d46a83067c9f73c071674b785f4747bf4cc5d2b682"}
Oct 30 21:22:39.860760 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.860750    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-7xpgb" event={"ID":"7735f8ec-f901-4584-b995-6f5b4bb14a79","Type":"ContainerStarted","Data":"126dde09b6b61e3178615ee48df1b3faa265973355d46d408097ad8519c5495b"}
Oct 30 21:22:39.861821 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.861778    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg" event={"ID":"a5d11da4-5f47-4bba-bc30-54df80304964","Type":"ContainerStarted","Data":"4719dd5a254d29d65621a9acf38fc6cece137d43ffd79ef25726ad4130359ece"}
Oct 30 21:22:39.863490 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.863433    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-2thg2" event={"ID":"db22bba6-c4a6-4ff0-8c60-60f0c4e61864","Type":"ContainerStarted","Data":"08135341690f79cf38e4a486c8719672f762267b9f9635a765706e16f1685f0a"}
Oct 30 21:22:39.865092 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:39.864739    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-h6pc5" event={"ID":"e7b27302-be59-4dc9-8e64-0ea2b2f4baa2","Type":"ContainerStarted","Data":"ed6eb69243a6015f118d16cdd86b43ba54733a08b946f7e413fa35608c608b04"}
Oct 30 21:22:40.033050 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.032981    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"]
Oct 30 21:22:40.036109 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:40.036000    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1737ddb3_e512_4944_8aad_94fac75a3a7e.slice/crio-32f3f34942f80b4fc656dda1ee653c4f26ad6ca4f094bcbb9c7578a9c5fc301c WatchSource:0}: Error finding container 32f3f34942f80b4fc656dda1ee653c4f26ad6ca4f094bcbb9c7578a9c5fc301c: Status 404 returned error can't find the container with id 32f3f34942f80b4fc656dda1ee653c4f26ad6ca4f094bcbb9c7578a9c5fc301c
Oct 30 21:22:40.036217 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.036201    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"]
Oct 30 21:22:40.038314 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:40.038295    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e2e6b5_2a6a_4d14_ad7a_784442fd6960.slice/crio-f7f31624c71b21638eb1c6b0da90d1855722588ac6e35b651c53eb994d5b7281 WatchSource:0}: Error finding container f7f31624c71b21638eb1c6b0da90d1855722588ac6e35b651c53eb994d5b7281: Status 404 returned error can't find the container with id f7f31624c71b21638eb1c6b0da90d1855722588ac6e35b651c53eb994d5b7281
Oct 30 21:22:40.585161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.585093    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:40.585161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.585121    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:40.585318 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.585235    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:40.585318 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.585245    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:40.585318 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.585289    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret podName:a5515bc6-8312-4be8-999c-9072fa30b526 nodeName:}" failed. No retries permitted until 2026-10-30 21:23:12.585276439 +0000 UTC m=+65.427083509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret") pod "global-pull-secret-syncer-s4z6n" (UID: "a5515bc6-8312-4be8-999c-9072fa30b526") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:22:40.585318 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.585302    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs podName:b9c410c1-b967-4f7c-8478-ff14cd4696b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:23:12.585295879 +0000 UTC m=+65.427102931 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs") pod "network-metrics-daemon-vps4x" (UID: "b9c410c1-b967-4f7c-8478-ff14cd4696b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:22:40.640341 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.640321    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:22:40.640460 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.640389    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:22:40.640460 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.640414    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:40.686142 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.686110    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:40.686483 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.686183    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:40.686483 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.686258    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:40.686483 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.686280    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:40.686483 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.686306    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:40.686483 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.686334    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:40.686483 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.686465    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:42.686447755 +0000 UTC m=+35.528254821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : configmap references non-existent config key: service-ca.crt
Oct 30 21:22:40.686704 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.686534    2543 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:22:40.686704 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.686564    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:42.686552016 +0000 UTC m=+35.528359069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : secret "router-metrics-certs-default" not found
Oct 30 21:22:40.686930 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.686908    2543 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:22:40.687052 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.686918    2543 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:40.687098 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.687051    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls podName:a0747bf5-ca98-4d2c-9723-3c226817ee66 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:42.687036127 +0000 UTC m=+35.528843196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-57r7x" (UID: "a0747bf5-ca98-4d2c-9723-3c226817ee66") : secret "samples-operator-tls" not found
Oct 30 21:22:40.687144 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.687103    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls podName:f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb nodeName:}" failed. No retries permitted until 2026-10-30 21:22:42.687083978 +0000 UTC m=+35.528891050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fwxj8" (UID: "f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:40.687144 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.686945    2543 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:22:40.687218 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.687161    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert podName:7ade972d-dd5c-4128-bdd8-98647d69d3a8 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:42.687150684 +0000 UTC m=+35.528957767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xc5td" (UID: "7ade972d-dd5c-4128-bdd8-98647d69d3a8") : secret "networking-console-plugin-cert" not found
Oct 30 21:22:40.689354 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.689321    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:40.695272 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.695231    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:22:40.695582 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.695553    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:22:40.695668 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.695637    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-jj5qw\""
Oct 30 21:22:40.695813 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.695786    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nr2gm\""
Oct 30 21:22:40.696134 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.696108    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-7rrvk\""
Oct 30 21:22:40.787068 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.787037    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:40.787239 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.787148    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:40.787386 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.787366    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:40.787543 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.787526    2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:22:40.787600 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.787587    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls podName:df296dbb-fcbc-44be-ac0d-9dc2c84481cc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:42.787569877 +0000 UTC m=+35.629376936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls") pod "dns-default-7fr7k" (UID: "df296dbb-fcbc-44be-ac0d-9dc2c84481cc") : secret "dns-default-metrics-tls" not found
Oct 30 21:22:40.787675 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.787663    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:40.787731 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.787675    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7659844d84-4hwr6: secret "image-registry-tls" not found
Oct 30 21:22:40.787731 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.787698    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls podName:8ecfcbcb-28ea-40cf-825b-5b01330c18e9 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:42.787691449 +0000 UTC m=+35.629498501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls") pod "image-registry-7659844d84-4hwr6" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9") : secret "image-registry-tls" not found
Oct 30 21:22:40.787832 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.787737    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:40.787832 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.787748    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b884d7489-6cmkh: secret "image-registry-tls" not found
Oct 30 21:22:40.787832 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:40.787783    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls podName:128967db-384e-471a-83f9-aff67d93c9cf nodeName:}" failed. No retries permitted until 2026-10-30 21:22:42.787772679 +0000 UTC m=+35.629579732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls") pod "image-registry-b884d7489-6cmkh" (UID: "128967db-384e-471a-83f9-aff67d93c9cf") : secret "image-registry-tls" not found
Oct 30 21:22:40.872699 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.872527    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg" event={"ID":"23e2e6b5-2a6a-4d14-ad7a-784442fd6960","Type":"ContainerStarted","Data":"f7f31624c71b21638eb1c6b0da90d1855722588ac6e35b651c53eb994d5b7281"}
Oct 30 21:22:40.876720 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.876685    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-h6pc5" event={"ID":"e7b27302-be59-4dc9-8e64-0ea2b2f4baa2","Type":"ContainerStarted","Data":"302201c092511bed62e1df09598d1888cc5e89ae949c6614f3f5f0c152c3ff56"}
Oct 30 21:22:40.880006 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.879958    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6" event={"ID":"1737ddb3-e512-4944-8aad-94fac75a3a7e","Type":"ContainerStarted","Data":"32f3f34942f80b4fc656dda1ee653c4f26ad6ca4f094bcbb9c7578a9c5fc301c"}
Oct 30 21:22:40.907952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.906350    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-7xpgb" podStartSLOduration=377.906334215 podStartE2EDuration="6m17.906334215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:40.784354955 +0000 UTC m=+33.626162020" watchObservedRunningTime="2026-10-30 21:22:40.906334215 +0000 UTC m=+33.748141289"
Oct 30 21:22:40.907952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.906674    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-h6pc5" podStartSLOduration=377.906662698 podStartE2EDuration="6m17.906662698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:40.906090164 +0000 UTC m=+33.747897239" watchObservedRunningTime="2026-10-30 21:22:40.906662698 +0000 UTC m=+33.748469774"
Oct 30 21:22:40.963755 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:40.963567    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:41.270394 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:41.270341    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-s5j2v" podStartSLOduration=378.270322067 podStartE2EDuration="6m18.270322067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:41.268811469 +0000 UTC m=+34.110618545" watchObservedRunningTime="2026-10-30 21:22:41.270322067 +0000 UTC m=+34.112129142"
Oct 30 21:22:41.369169 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:41.369043    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm2pw"]
Oct 30 21:22:41.380444 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:41.380410    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0604fbf5_9b44_4c5e_b17a_f7ddc98ad68f.slice/crio-08d11690d865dc79a5ea3cfc3ad679ba2d6a5191264b2fe8757364f4d3dca048 WatchSource:0}: Error finding container 08d11690d865dc79a5ea3cfc3ad679ba2d6a5191264b2fe8757364f4d3dca048: Status 404 returned error can't find the container with id 08d11690d865dc79a5ea3cfc3ad679ba2d6a5191264b2fe8757364f4d3dca048
Oct 30 21:22:41.891759 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:41.891235    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm2pw" event={"ID":"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f","Type":"ContainerStarted","Data":"08d11690d865dc79a5ea3cfc3ad679ba2d6a5191264b2fe8757364f4d3dca048"}
Oct 30 21:22:42.288057 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.287934    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:42.501385 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.501351    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:42.691824 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.691737    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.709879    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.709935    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.709993    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.710114    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.710185    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.710358    2543 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.710415    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:46.710398882 +0000 UTC m=+39.552205949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : secret "router-metrics-certs-default" not found
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.710810    2543 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.710861    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert podName:7ade972d-dd5c-4128-bdd8-98647d69d3a8 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:46.71084603 +0000 UTC m=+39.552653097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xc5td" (UID: "7ade972d-dd5c-4128-bdd8-98647d69d3a8") : secret "networking-console-plugin-cert" not found
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.710923    2543 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:22:42.711010 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.710956    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls podName:a0747bf5-ca98-4d2c-9723-3c226817ee66 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:46.710944822 +0000 UTC m=+39.552751890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-57r7x" (UID: "a0747bf5-ca98-4d2c-9723-3c226817ee66") : secret "samples-operator-tls" not found
Oct 30 21:22:42.711612 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.711032    2543 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:42.711612 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.711065    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls podName:f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb nodeName:}" failed. No retries permitted until 2026-10-30 21:22:46.711054064 +0000 UTC m=+39.552861130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fwxj8" (UID: "f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:42.711612 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.711223    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:46.711211936 +0000 UTC m=+39.553019001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : configmap references non-existent config key: service-ca.crt
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.810989    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.811057    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.811087    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.811259    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.811276    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b884d7489-6cmkh: secret "image-registry-tls" not found
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.811330    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls podName:128967db-384e-471a-83f9-aff67d93c9cf nodeName:}" failed. No retries permitted until 2026-10-30 21:22:46.811312769 +0000 UTC m=+39.653119823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls") pod "image-registry-b884d7489-6cmkh" (UID: "128967db-384e-471a-83f9-aff67d93c9cf") : secret "image-registry-tls" not found
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.811427    2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.811490    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls podName:df296dbb-fcbc-44be-ac0d-9dc2c84481cc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:46.811477145 +0000 UTC m=+39.653284196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls") pod "dns-default-7fr7k" (UID: "df296dbb-fcbc-44be-ac0d-9dc2c84481cc") : secret "dns-default-metrics-tls" not found
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.811540    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.811548    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7659844d84-4hwr6: secret "image-registry-tls" not found
Oct 30 21:22:42.811655 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:42.811581    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls podName:8ecfcbcb-28ea-40cf-825b-5b01330c18e9 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:46.811572262 +0000 UTC m=+39.653379315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls") pod "image-registry-7659844d84-4hwr6" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9") : secret "image-registry-tls" not found
Oct 30 21:22:42.863789 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.863725    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:42.897672 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:42.897010    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg" event={"ID":"a5d11da4-5f47-4bba-bc30-54df80304964","Type":"ContainerStarted","Data":"e846765e9806132321d093a62859f4ccca21e171b340e8d0079562c8bcbe7063"}
Oct 30 21:22:43.013989 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:43.013919    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg" podStartSLOduration=346.237814021 podStartE2EDuration="5m49.013904703s" totalImagesPullingTime="2.776090682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:43.013356562 +0000 UTC m=+35.855163637" watchObservedRunningTime="2026-10-30 21:22:43.013904703 +0000 UTC m=+35.855711776"
Oct 30 21:22:43.146192 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:43.146088    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:43.691340 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:43.691308    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:44.906617 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:44.906573    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/0.log"
Oct 30 21:22:44.907071 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:44.906619    2543 generic.go:356] "Generic (PLEG): container finished" podID="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387" containerID="6174c1bd45c5195befbc7c606d17d2b9e28aab1476c90cceefc26e6cc976c566" exitCode=255
Oct 30 21:22:44.907071 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:44.906672    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" event={"ID":"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387","Type":"ContainerDied","Data":"6174c1bd45c5195befbc7c606d17d2b9e28aab1476c90cceefc26e6cc976c566"}
Oct 30 21:22:44.907175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:44.907130    2543 scope.go:122] "RemoveContainer" containerID="6174c1bd45c5195befbc7c606d17d2b9e28aab1476c90cceefc26e6cc976c566"
Oct 30 21:22:45.912420 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.912378    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-2thg2" event={"ID":"db22bba6-c4a6-4ff0-8c60-60f0c4e61864","Type":"ContainerStarted","Data":"3f99d5b2ec87e8e4a9790bc762d38f791059db53b92b77faebd8332491e4766d"}
Oct 30 21:22:45.914995 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.914894    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m" event={"ID":"39c99098-aa34-4200-b2a4-2404ae1cd454","Type":"ContainerStarted","Data":"bc771fe37ec997994de94af77b20903b9538071b11eae7ab713f18c6833501e5"}
Oct 30 21:22:45.917429 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.917377    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g8nnl" event={"ID":"eb9de1fa-933d-49a5-84ed-2418c40eead3","Type":"ContainerStarted","Data":"7055f34a8f1e60487d940fa511cdd279015cf8eab7daf1b3d6c734fcb22d4aa8"}
Oct 30 21:22:45.919224 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.919204    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/1.log"
Oct 30 21:22:45.919662 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.919644    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/0.log"
Oct 30 21:22:45.919738 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.919681    2543 generic.go:356] "Generic (PLEG): container finished" podID="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387" containerID="f05689993416c24fad4687cf248e4f759a87801f04ac0f965265060d9feba154" exitCode=255
Oct 30 21:22:45.919793 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.919747    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" event={"ID":"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387","Type":"ContainerDied","Data":"f05689993416c24fad4687cf248e4f759a87801f04ac0f965265060d9feba154"}
Oct 30 21:22:45.919793 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.919788    2543 scope.go:122] "RemoveContainer" containerID="6174c1bd45c5195befbc7c606d17d2b9e28aab1476c90cceefc26e6cc976c566"
Oct 30 21:22:45.920157 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.920143    2543 scope.go:122] "RemoveContainer" containerID="f05689993416c24fad4687cf248e4f759a87801f04ac0f965265060d9feba154"
Oct 30 21:22:45.920355 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:45.920335    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hk9c_openshift-console-operator(e4efa2f2-5d48-40f5-bfc2-d4f858a4c387)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" podUID="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387"
Oct 30 21:22:45.922309 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:45.922233    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg" event={"ID":"23e2e6b5-2a6a-4d14-ad7a-784442fd6960","Type":"ContainerStarted","Data":"6108f79bc49415ca38c245a953fd04347862b610e5975fa24c71feb80e026ced"}
Oct 30 21:22:46.035930 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.035282    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-2thg2" podStartSLOduration=346.711690081 podStartE2EDuration="5m52.035262154s" totalImagesPullingTime="5.323572073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:46.034036714 +0000 UTC m=+38.875843789" watchObservedRunningTime="2026-10-30 21:22:46.035262154 +0000 UTC m=+38.877069225"
Oct 30 21:22:46.118873 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.118846    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:46.154997 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.154925    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g8nnl" podStartSLOduration=2.220679412 podStartE2EDuration="8.15490774s" totalImagesPullingTime="5.934228328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:46.153501325 +0000 UTC m=+38.995308398" watchObservedRunningTime="2026-10-30 21:22:46.15490774 +0000 UTC m=+38.996714815"
Oct 30 21:22:46.272181 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.272124    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg" podStartSLOduration=346.883080867 podStartE2EDuration="5m52.272106704s" totalImagesPullingTime="5.389025837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:46.271733436 +0000 UTC m=+39.113540514" watchObservedRunningTime="2026-10-30 21:22:46.272106704 +0000 UTC m=+39.113913779"
Oct 30 21:22:46.293649 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.293571    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:46.511250 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.511197    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m" podStartSLOduration=347.171042255 podStartE2EDuration="5m52.511179888s" totalImagesPullingTime="5.340137633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:46.510723979 +0000 UTC m=+39.352531055" watchObservedRunningTime="2026-10-30 21:22:46.511179888 +0000 UTC m=+39.352986959"
Oct 30 21:22:46.585375 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.585343    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jbkhl"]
Oct 30 21:22:46.595201 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.595167    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:46.604789 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.604766    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.650622 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.650592    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jbkhl"]
Oct 30 21:22:46.662142 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.662110    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:22:46.662300 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.662284    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5nrzq\""
Oct 30 21:22:46.741664 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.741639    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:22:46.752691 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.752667    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.752851 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.752705    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.752851 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.752726    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:46.752851 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.752811    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64cf3434-1c3d-4036-9a55-4eb3958b16d4-data-volume\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.752851 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.752838    2543 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:22:46.753035 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.752904    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert podName:7ade972d-dd5c-4128-bdd8-98647d69d3a8 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.752887993 +0000 UTC m=+47.594695048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xc5td" (UID: "7ade972d-dd5c-4128-bdd8-98647d69d3a8") : secret "networking-console-plugin-cert" not found
Oct 30 21:22:46.753035 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.752989    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:46.753146 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.753078    2543 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:22:46.753146 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.753100    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:46.753146 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.753126    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls podName:a0747bf5-ca98-4d2c-9723-3c226817ee66 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.753111163 +0000 UTC m=+47.594918229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-57r7x" (UID: "a0747bf5-ca98-4d2c-9723-3c226817ee66") : secret "samples-operator-tls" not found
Oct 30 21:22:46.753296 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.753181    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:46.753296 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.753192    2543 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:46.753296 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.753239    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls podName:f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.753224694 +0000 UTC m=+47.595031765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fwxj8" (UID: "f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:46.753296 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.753260    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bh79\" (UniqueName: \"kubernetes.io/projected/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-api-access-8bh79\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.753296 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.753282    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.753272418 +0000 UTC m=+47.595079495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : configmap references non-existent config key: service-ca.crt
Oct 30 21:22:46.753482 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.753308    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64cf3434-1c3d-4036-9a55-4eb3958b16d4-crio-socket\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.753482 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.753337    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:46.753482 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.753449    2543 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:22:46.753580 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.753492    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.75348222 +0000 UTC m=+47.595289274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : secret "router-metrics-certs-default" not found
Oct 30 21:22:46.764727 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.764704    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:46.780159 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.780131    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"]
Oct 30 21:22:46.793976 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.793937    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"
Oct 30 21:22:46.840628 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.840601    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"]
Oct 30 21:22:46.854113 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854088    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.854217 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854137    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.854217 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854172    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64cf3434-1c3d-4036-9a55-4eb3958b16d4-data-volume\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.854298 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854234    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:46.854298 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854256    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bh79\" (UniqueName: \"kubernetes.io/projected/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-api-access-8bh79\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.854298 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854234    2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:46.854444 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854324    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64cf3434-1c3d-4036-9a55-4eb3958b16d4-crio-socket\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.854444 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854273    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64cf3434-1c3d-4036-9a55-4eb3958b16d4-crio-socket\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.854444 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854333    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:47.354314833 +0000 UTC m=+40.196121889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:46.854444 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854265    2543 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:22:46.854444 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854373    2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:22:46.854444 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854405    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls podName:df296dbb-fcbc-44be-ac0d-9dc2c84481cc nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.854397341 +0000 UTC m=+47.696204414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls") pod "dns-default-7fr7k" (UID: "df296dbb-fcbc-44be-ac0d-9dc2c84481cc") : secret "dns-default-metrics-tls" not found
Oct 30 21:22:46.854444 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854406    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:46.854444 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854433    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:47.35441435 +0000 UTC m=+40.196221402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : configmap "kube-rbac-proxy" not found
Oct 30 21:22:46.854725 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854479    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64cf3434-1c3d-4036-9a55-4eb3958b16d4-data-volume\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.854725 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.854488    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:46.854725 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854496    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:46.854725 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854507    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7659844d84-4hwr6: secret "image-registry-tls" not found
Oct 30 21:22:46.854725 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854556    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls podName:8ecfcbcb-28ea-40cf-825b-5b01330c18e9 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.854546805 +0000 UTC m=+47.696353857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls") pod "image-registry-7659844d84-4hwr6" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9") : secret "image-registry-tls" not found
Oct 30 21:22:46.854725 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854556    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:46.854725 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854569    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b884d7489-6cmkh: secret "image-registry-tls" not found
Oct 30 21:22:46.854725 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.854594    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls podName:128967db-384e-471a-83f9-aff67d93c9cf nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.854586417 +0000 UTC m=+47.696393468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls") pod "image-registry-b884d7489-6cmkh" (UID: "128967db-384e-471a-83f9-aff67d93c9cf") : secret "image-registry-tls" not found
Oct 30 21:22:46.860877 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.860856    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5wvjr\""
Oct 30 21:22:46.917777 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.917755    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bh79\" (UniqueName: \"kubernetes.io/projected/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-api-access-8bh79\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:46.924057 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.924030    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:46.926766 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.926748    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/1.log"
Oct 30 21:22:46.927108 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.927080    2543 scope.go:122] "RemoveContainer" containerID="f05689993416c24fad4687cf248e4f759a87801f04ac0f965265060d9feba154"
Oct 30 21:22:46.927276 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:46.927250    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hk9c_openshift-console-operator(e4efa2f2-5d48-40f5-bfc2-d4f858a4c387)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" podUID="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387"
Oct 30 21:22:46.928320 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.928297    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6" event={"ID":"1737ddb3-e512-4944-8aad-94fac75a3a7e","Type":"ContainerStarted","Data":"a3c3365c30e70bf42b1ced3db91900be91064d128ce814329a70b38a380f2b25"}
Oct 30 21:22:46.940188 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.940168    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:22:46.940272 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.940251    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:22:46.955311 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:46.955288    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjs68\" (UniqueName: \"kubernetes.io/projected/760c893e-a6be-4c31-ad76-c1922d08a5d4-kube-api-access-mjs68\") pod \"migrator-66df5d496b-749th\" (UID: \"760c893e-a6be-4c31-ad76-c1922d08a5d4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"
Oct 30 21:22:47.056472 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.056410    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjs68\" (UniqueName: \"kubernetes.io/projected/760c893e-a6be-4c31-ad76-c1922d08a5d4-kube-api-access-mjs68\") pod \"migrator-66df5d496b-749th\" (UID: \"760c893e-a6be-4c31-ad76-c1922d08a5d4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"
Oct 30 21:22:47.084453 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.084409    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:47.117477 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.117453    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjs68\" (UniqueName: \"kubernetes.io/projected/760c893e-a6be-4c31-ad76-c1922d08a5d4-kube-api-access-mjs68\") pod \"migrator-66df5d496b-749th\" (UID: \"760c893e-a6be-4c31-ad76-c1922d08a5d4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"
Oct 30 21:22:47.129335 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.129309    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"
Oct 30 21:22:47.166507 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.166466    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6" podStartSLOduration=346.843510321 podStartE2EDuration="5m53.166454336s" totalImagesPullingTime="6.322944015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:47.166111427 +0000 UTC m=+40.007918503" watchObservedRunningTime="2026-10-30 21:22:47.166454336 +0000 UTC m=+40.008261410"
Oct 30 21:22:47.241138 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.241089    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:47.360145 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.360086    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:47.360251 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.360141    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:47.360251 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:47.360211    2543 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:22:47.360251 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:47.360225    2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:47.360340 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:47.360269    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:48.360256038 +0000 UTC m=+41.202063090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : configmap "kube-rbac-proxy" not found
Oct 30 21:22:47.360340 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:47.360282    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:48.360275825 +0000 UTC m=+41.202082876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:47.518954 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.518934    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"]
Oct 30 21:22:47.520737 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:22:47.520715    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760c893e_a6be_4c31_ad76_c1922d08a5d4.slice/crio-8d80326ad1588cb52a3437536457829135aafa79deab8a6eedba50e03a51a17b WatchSource:0}: Error finding container 8d80326ad1588cb52a3437536457829135aafa79deab8a6eedba50e03a51a17b: Status 404 returned error can't find the container with id 8d80326ad1588cb52a3437536457829135aafa79deab8a6eedba50e03a51a17b
Oct 30 21:22:47.934461 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.934423    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm2pw" event={"ID":"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f","Type":"ContainerStarted","Data":"c21b3e25c1635bf9a6957a3e5a3c84c8b06ba90ed4ade893462d6355a8d68ea6"}
Oct 30 21:22:47.934898 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.934491    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:22:47.935888 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:47.935860    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th" event={"ID":"760c893e-a6be-4c31-ad76-c1922d08a5d4","Type":"ContainerStarted","Data":"8d80326ad1588cb52a3437536457829135aafa79deab8a6eedba50e03a51a17b"}
Oct 30 21:22:48.052092 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:48.052041    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qm2pw" podStartSLOduration=34.450631067 podStartE2EDuration="40.052027174s" totalImagesPullingTime="5.601396107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:48.050905874 +0000 UTC m=+40.892712948" watchObservedRunningTime="2026-10-30 21:22:48.052027174 +0000 UTC m=+40.893834272"
Oct 30 21:22:48.305862 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:48.305787    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:48.368593 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:48.368564    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:48.368696 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:48.368669    2543 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:22:48.368743 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:48.368711    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:48.368743 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:48.368725    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:50.368708771 +0000 UTC m=+43.210515823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : configmap "kube-rbac-proxy" not found
Oct 30 21:22:48.368810 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:48.368784    2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:48.368843 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:48.368834    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:50.368823517 +0000 UTC m=+43.210630570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:48.456591 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:48.456540    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:49.051095 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:49.051063    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:49.319065 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:49.319006    2543 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:49.319065 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:49.319050    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:49.319343 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:49.319331    2543 scope.go:122] "RemoveContainer" containerID="f05689993416c24fad4687cf248e4f759a87801f04ac0f965265060d9feba154"
Oct 30 21:22:49.319500 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:49.319482    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hk9c_openshift-console-operator(e4efa2f2-5d48-40f5-bfc2-d4f858a4c387)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" podUID="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387"
Oct 30 21:22:49.944107 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:49.944074    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th" event={"ID":"760c893e-a6be-4c31-ad76-c1922d08a5d4","Type":"ContainerStarted","Data":"6f5e9a5e5ca4f4895a810c4fc94b7988553a0f9f9536b37da971234858bd39a7"}
Oct 30 21:22:50.063042 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:50.062995    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th" podStartSLOduration=2.004483228 podStartE2EDuration="4.062977295s" totalImagesPullingTime="2.058494067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:50.062102059 +0000 UTC m=+42.903909134" watchObservedRunningTime="2026-10-30 21:22:50.062977295 +0000 UTC m=+42.904784362"
Oct 30 21:22:50.386036 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:50.386011    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:50.386161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:50.386049    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:50.386161 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:50.386149    2543 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:22:50.386232 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:50.386149    2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:50.386232 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:50.386205    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.386192261 +0000 UTC m=+47.227999330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:50.386232 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:50.386218    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:54.386211879 +0000 UTC m=+47.228018931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : configmap "kube-rbac-proxy" not found
Oct 30 21:22:51.075944 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:51.075916    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:51.231864 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:51.231841    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:52.055332 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:52.055292    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:52.367149 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:52.367085    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:54.421769 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.421739    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:54.422153 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.421776    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:54.422153 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.421881    2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:54.422153 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.421938    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:23:02.421923822 +0000 UTC m=+55.263730887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:22:54.422308 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.422291    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:22:54.824525 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.824453    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:54.824664 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.824551    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:22:54.824664 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.824575    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:22:54.824664 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.824596    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:22:54.824664 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.824616    2543 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:22:54.824820 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.824620    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:22:54.824820 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.824678    2543 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:22:54.824820 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.824696    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:23:10.824676197 +0000 UTC m=+63.666483270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : secret "router-metrics-certs-default" not found
Oct 30 21:22:54.824820 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.824714    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle podName:0dae4f31-8ea9-480a-881f-61bad1def6bc nodeName:}" failed. No retries permitted until 2026-10-30 21:23:10.824708738 +0000 UTC m=+63.666515790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle") pod "router-default-66bc45fc97-b8kwb" (UID: "0dae4f31-8ea9-480a-881f-61bad1def6bc") : configmap references non-existent config key: service-ca.crt
Oct 30 21:22:54.824820 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.824717    2543 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:22:54.824820 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.824742    2543 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:54.824820 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.824771    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls podName:a0747bf5-ca98-4d2c-9723-3c226817ee66 nodeName:}" failed. No retries permitted until 2026-10-30 21:23:10.824752196 +0000 UTC m=+63.666559264 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-57r7x" (UID: "a0747bf5-ca98-4d2c-9723-3c226817ee66") : secret "samples-operator-tls" not found
Oct 30 21:22:54.824820 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.824793    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert podName:7ade972d-dd5c-4128-bdd8-98647d69d3a8 nodeName:}" failed. No retries permitted until 2026-10-30 21:23:10.824777389 +0000 UTC m=+63.666584460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xc5td" (UID: "7ade972d-dd5c-4128-bdd8-98647d69d3a8") : secret "networking-console-plugin-cert" not found
Oct 30 21:22:54.824820 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.824808    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls podName:f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb nodeName:}" failed. No retries permitted until 2026-10-30 21:23:10.824801318 +0000 UTC m=+63.666608370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fwxj8" (UID: "f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:22:54.925597 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.925567    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:22:54.925729 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.925611    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:22:54.925729 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:54.925642    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls\") pod \"image-registry-b884d7489-6cmkh\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") " pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:22:54.925729 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.925701    2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:22:54.925840 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.925753    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls podName:df296dbb-fcbc-44be-ac0d-9dc2c84481cc nodeName:}" failed. No retries permitted until 2026-10-30 21:23:10.925736447 +0000 UTC m=+63.767543517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls") pod "dns-default-7fr7k" (UID: "df296dbb-fcbc-44be-ac0d-9dc2c84481cc") : secret "dns-default-metrics-tls" not found
Oct 30 21:22:54.925840 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.925760    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:54.925840 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.925776    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7659844d84-4hwr6: secret "image-registry-tls" not found
Oct 30 21:22:54.925840 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.925793    2543 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:22:54.925840 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.925807    2543 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b884d7489-6cmkh: secret "image-registry-tls" not found
Oct 30 21:22:54.925840 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.925817    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls podName:8ecfcbcb-28ea-40cf-825b-5b01330c18e9 nodeName:}" failed. No retries permitted until 2026-10-30 21:23:10.925805818 +0000 UTC m=+63.767612870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls") pod "image-registry-7659844d84-4hwr6" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9") : secret "image-registry-tls" not found
Oct 30 21:22:54.925840 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:54.925832    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls podName:128967db-384e-471a-83f9-aff67d93c9cf nodeName:}" failed. No retries permitted until 2026-10-30 21:23:10.925824623 +0000 UTC m=+63.767631693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls") pod "image-registry-b884d7489-6cmkh" (UID: "128967db-384e-471a-83f9-aff67d93c9cf") : secret "image-registry-tls" not found
Oct 30 21:22:55.400856 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:55.400827    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cgnp7_2523fa7a-1747-4695-a737-5c2a1caf2864/dns-node-resolver/0.log"
Oct 30 21:22:55.551746 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:55.551661    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:55.958849 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:55.958811    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:56.143903 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:56.143871    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:56.344806 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:56.344743    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4gdh_6bfa550e-e2f4-4549-993f-5bbe3ebac5c2/node-ca/0.log"
Oct 30 21:22:56.345008 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:56.344888    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:56.680678 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:56.680649    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:57.118820 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:57.118731    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g8nnl_eb9de1fa-933d-49a5-84ed-2418c40eead3/serve-healthcheck-canary/0.log"
Oct 30 21:22:57.320400 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:57.320353    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-749th_760c893e-a6be-4c31-ad76-c1922d08a5d4/migrator/0.log"
Oct 30 21:22:57.428294 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:57.428248    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:57.624612 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:57.624569    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:57.718435 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:57.718375    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m_39c99098-aa34-4200-b2a4-2404ae1cd454/kube-storage-version-migrator-operator/0.log"
Oct 30 21:22:57.780254 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:57.780223    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:57.931862 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:57.931843    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:58.086554 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:58.086493    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:58.239668 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:58.239645    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:58.641161 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:58.641137    2543 scope.go:122] "RemoveContainer" containerID="f05689993416c24fad4687cf248e4f759a87801f04ac0f965265060d9feba154"
Oct 30 21:22:58.974737 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:58.974674    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:22:58.975123 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:58.975108    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/1.log"
Oct 30 21:22:58.975163 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:58.975139    2543 generic.go:356] "Generic (PLEG): container finished" podID="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387" containerID="8a19b13d667539386e0bf276e5822ee76936e8869fd3e3df8220508c53ab4513" exitCode=255
Oct 30 21:22:58.975205 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:58.975189    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" event={"ID":"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387","Type":"ContainerDied","Data":"8a19b13d667539386e0bf276e5822ee76936e8869fd3e3df8220508c53ab4513"}
Oct 30 21:22:58.975258 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:58.975232    2543 scope.go:122] "RemoveContainer" containerID="f05689993416c24fad4687cf248e4f759a87801f04ac0f965265060d9feba154"
Oct 30 21:22:58.975483 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:58.975464    2543 scope.go:122] "RemoveContainer" containerID="8a19b13d667539386e0bf276e5822ee76936e8869fd3e3df8220508c53ab4513"
Oct 30 21:22:58.975682 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:58.975661    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hk9c_openshift-console-operator(e4efa2f2-5d48-40f5-bfc2-d4f858a4c387)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" podUID="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387"
Oct 30 21:22:59.318230 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:59.318156    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:59.318230 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:59.318215    2543 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:22:59.428174 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:59.428127    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:59.624357 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:59.624264    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:59.825831 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:59.825805    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:59.979626 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:59.979607    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:22:59.979952 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:22:59.979873    2543 scope.go:122] "RemoveContainer" containerID="8a19b13d667539386e0bf276e5822ee76936e8869fd3e3df8220508c53ab4513"
Oct 30 21:22:59.980054 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:22:59.980034    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hk9c_openshift-console-operator(e4efa2f2-5d48-40f5-bfc2-d4f858a4c387)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" podUID="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387"
Oct 30 21:23:00.028005 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:00.027983    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:00.223100 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:00.223069    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:01.184871 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:01.184837    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:01.429982 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:01.429934    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:01.628275 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:01.628208    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:01.825727 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:01.825697    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:02.022304 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:02.022272    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:02.227732 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:02.227710    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:02.488074 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:02.488041    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:02.488237 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:23:02.488190    2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:23:02.488278 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:23:02.488245    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls podName:64cf3434-1c3d-4036-9a55-4eb3958b16d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:23:18.488231387 +0000 UTC m=+71.330038453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbkhl" (UID: "64cf3434-1c3d-4036-9a55-4eb3958b16d4") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:23:03.428468 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:03.428435    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:03.628108 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:03.628070    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:03.823726 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:03.823630    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:03.851738 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:03.851716    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:03.978595 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:03.978566    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:04.129658 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:04.129587    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:04.318168 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:04.318123    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:05.424374 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:05.424343    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:05.629863 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:05.629833    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:05.824420 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:05.824341    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:06.023643 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:06.023613    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:06.227483 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:06.227437    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:07.371389 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:07.371363    2543 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b884d7489-6cmkh"]
Oct 30 21:23:07.371814 ip-10-0-136-135 kubenswrapper[2543]: E1030 21:23:07.371501    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-b884d7489-6cmkh" podUID="128967db-384e-471a-83f9-aff67d93c9cf"
Oct 30 21:23:07.465105 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:07.465080    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:07.661456 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:07.661417    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:07.824840 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:07.824806    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:07.978133 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:07.978064    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:08.002765 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.002737    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:23:08.008160 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.008144    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:23:08.130901 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.130880    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:08.136755 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.136739    2543 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-kube-api-access-4vpbb\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-kube-api-access-4vpbb\") pod \"128967db-384e-471a-83f9-aff67d93c9cf\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") "
Oct 30 21:23:08.136807 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.136770    2543 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-installation-pull-secrets\") pod \"128967db-384e-471a-83f9-aff67d93c9cf\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") "
Oct 30 21:23:08.136807 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.136794    2543 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/128967db-384e-471a-83f9-aff67d93c9cf-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/128967db-384e-471a-83f9-aff67d93c9cf-ca-trust-extracted\") pod \"128967db-384e-471a-83f9-aff67d93c9cf\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") "
Oct 30 21:23:08.136884 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.136822    2543 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-registry-certificates\") pod \"128967db-384e-471a-83f9-aff67d93c9cf\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") "
Oct 30 21:23:08.136935 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.136912    2543 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-image-registry-private-configuration\") pod \"128967db-384e-471a-83f9-aff67d93c9cf\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") "
Oct 30 21:23:08.137003 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.136958    2543 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-trusted-ca\") pod \"128967db-384e-471a-83f9-aff67d93c9cf\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") "
Oct 30 21:23:08.137063 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.137016    2543 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-bound-sa-token\") pod \"128967db-384e-471a-83f9-aff67d93c9cf\" (UID: \"128967db-384e-471a-83f9-aff67d93c9cf\") "
Oct 30 21:23:08.137119 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.137098    2543 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128967db-384e-471a-83f9-aff67d93c9cf-ca-trust-extracted" pod "128967db-384e-471a-83f9-aff67d93c9cf" (UID: "128967db-384e-471a-83f9-aff67d93c9cf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:08.137241 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.137177    2543 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-registry-certificates" pod "128967db-384e-471a-83f9-aff67d93c9cf" (UID: "128967db-384e-471a-83f9-aff67d93c9cf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:08.137333 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.137314    2543 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/128967db-384e-471a-83f9-aff67d93c9cf-ca-trust-extracted\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:08.137440 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.137337    2543 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-registry-certificates\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:08.137440 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.137379    2543 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-trusted-ca" pod "128967db-384e-471a-83f9-aff67d93c9cf" (UID: "128967db-384e-471a-83f9-aff67d93c9cf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:08.139158 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.139130    2543 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-kube-api-access-4vpbb" pod "128967db-384e-471a-83f9-aff67d93c9cf" (UID: "128967db-384e-471a-83f9-aff67d93c9cf"). InnerVolumeSpecName "kube-api-access-4vpbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:08.139240 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.139201    2543 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-image-registry-private-configuration" pod "128967db-384e-471a-83f9-aff67d93c9cf" (UID: "128967db-384e-471a-83f9-aff67d93c9cf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:23:08.139240 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.139228    2543 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-bound-sa-token" pod "128967db-384e-471a-83f9-aff67d93c9cf" (UID: "128967db-384e-471a-83f9-aff67d93c9cf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:08.139317 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.139227    2543 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-installation-pull-secrets" pod "128967db-384e-471a-83f9-aff67d93c9cf" (UID: "128967db-384e-471a-83f9-aff67d93c9cf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:23:08.238658 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.238608    2543 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vpbb\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-kube-api-access-4vpbb\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:08.238658 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.238627    2543 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-installation-pull-secrets\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:08.238658 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.238639    2543 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/128967db-384e-471a-83f9-aff67d93c9cf-image-registry-private-configuration\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:08.238658 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.238650    2543 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/128967db-384e-471a-83f9-aff67d93c9cf-trusted-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:08.238658 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.238658    2543 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-bound-sa-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:08.294528 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:08.294505    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:09.005013 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:09.004987    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b884d7489-6cmkh"
Oct 30 21:23:09.291727 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:09.291663    2543 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b884d7489-6cmkh"]
Oct 30 21:23:09.297043 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:09.297020    2543 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b884d7489-6cmkh"]
Oct 30 21:23:09.347298 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:09.347275    2543 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/128967db-384e-471a-83f9-aff67d93c9cf-registry-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:09.647406 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:09.647373    2543 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="128967db-384e-471a-83f9-aff67d93c9cf" path="/var/lib/kubelet/pods/128967db-384e-471a-83f9-aff67d93c9cf/volumes"
Oct 30 21:23:10.111014 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.110921    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:10.745188 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.745156    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:10.859009 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.858977    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:10.859162 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.859071    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:23:10.859162 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.859101    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:23:10.859162 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.859127    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:23:10.859289 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.859164    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:10.860044 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.860013    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:10.861430 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.861402    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:10.861659 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.861635    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:23:10.861714 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.861661    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:23:10.861714 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.861703    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:23:10.934948 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.934916    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:10.960326 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.960299    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:10.960443 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.960334    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:10.962655 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.962634    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:10.962809 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:10.962793    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:11.077318 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.077258    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:23:11.090779 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.090760    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:11.098611 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.098586    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:23:11.105081 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.105056    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:11.122750 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.122718    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-5nb2r\""
Oct 30 21:23:11.131931 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.131789    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:23:11.212764 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.212737    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pdhmp\""
Oct 30 21:23:11.221050 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.221024    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:11.232094 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.232078    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjpnc\""
Oct 30 21:23:11.241175 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.241155    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:11.262367 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.262347    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:11.479131 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.479102    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"]
Oct 30 21:23:11.490525 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:23:11.490493    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a3a4e1_69eb_46a4_bde6_5ccd1a00bdcb.slice/crio-8cf8f7d0377ef4fec32c5869b67a9120b502a51b0b2498b48e5ceef81576a8ed WatchSource:0}: Error finding container 8cf8f7d0377ef4fec32c5869b67a9120b502a51b0b2498b48e5ceef81576a8ed: Status 404 returned error can't find the container with id 8cf8f7d0377ef4fec32c5869b67a9120b502a51b0b2498b48e5ceef81576a8ed
Oct 30 21:23:11.501387 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.501365    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"]
Oct 30 21:23:11.532283 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.532261    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66bc45fc97-b8kwb"]
Oct 30 21:23:11.542428 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:23:11.542402    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dae4f31_8ea9_480a_881f_61bad1def6bc.slice/crio-99e1f978397ad7f650145477ce2aca2f469893aa3fae44bc7e84fcfada4b418f WatchSource:0}: Error finding container 99e1f978397ad7f650145477ce2aca2f469893aa3fae44bc7e84fcfada4b418f: Status 404 returned error can't find the container with id 99e1f978397ad7f650145477ce2aca2f469893aa3fae44bc7e84fcfada4b418f
Oct 30 21:23:11.550756 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.550170    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-xc5td"]
Oct 30 21:23:11.552763 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:23:11.552741    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ade972d_dd5c_4128_bdd8_98647d69d3a8.slice/crio-b8e7b34c90abddc1961c748b822216734a01e82bf0cf9dd3823c751416a91dd1 WatchSource:0}: Error finding container b8e7b34c90abddc1961c748b822216734a01e82bf0cf9dd3823c751416a91dd1: Status 404 returned error can't find the container with id b8e7b34c90abddc1961c748b822216734a01e82bf0cf9dd3823c751416a91dd1
Oct 30 21:23:11.607897 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.607874    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7659844d84-4hwr6"]
Oct 30 21:23:11.609937 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:23:11.609911    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecfcbcb_28ea_40cf_825b_5b01330c18e9.slice/crio-c117e5da23d812319064ebe402a785391e922e428ef375b1067c386291417f14 WatchSource:0}: Error finding container c117e5da23d812319064ebe402a785391e922e428ef375b1067c386291417f14: Status 404 returned error can't find the container with id c117e5da23d812319064ebe402a785391e922e428ef375b1067c386291417f14
Oct 30 21:23:11.616885 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:11.616864    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7fr7k"]
Oct 30 21:23:11.620379 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:23:11.619820    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf296dbb_fcbc_44be_ac0d_9dc2c84481cc.slice/crio-0cc85c1ed36232ce5e9b7c84aa202701d1ebff7ad6db003a7e352af983f6c949 WatchSource:0}: Error finding container 0cc85c1ed36232ce5e9b7c84aa202701d1ebff7ad6db003a7e352af983f6c949: Status 404 returned error can't find the container with id 0cc85c1ed36232ce5e9b7c84aa202701d1ebff7ad6db003a7e352af983f6c949
Oct 30 21:23:12.015222 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.015181    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7fr7k" event={"ID":"df296dbb-fcbc-44be-ac0d-9dc2c84481cc","Type":"ContainerStarted","Data":"0cc85c1ed36232ce5e9b7c84aa202701d1ebff7ad6db003a7e352af983f6c949"}
Oct 30 21:23:12.016455 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.016417    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td" event={"ID":"7ade972d-dd5c-4128-bdd8-98647d69d3a8","Type":"ContainerStarted","Data":"b8e7b34c90abddc1961c748b822216734a01e82bf0cf9dd3823c751416a91dd1"}
Oct 30 21:23:12.017389 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.017368    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x" event={"ID":"a0747bf5-ca98-4d2c-9723-3c226817ee66","Type":"ContainerStarted","Data":"408c940f390e9a3d5655b0ab46ca761c1b191efe2e7c2aa6a07d06e6a3b51e6f"}
Oct 30 21:23:12.018670 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.018645    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66bc45fc97-b8kwb" event={"ID":"0dae4f31-8ea9-480a-881f-61bad1def6bc","Type":"ContainerStarted","Data":"5cecc3089ba6cbd711197127db20159059a5e4139b658ef0790020caf3645f10"}
Oct 30 21:23:12.018765 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.018695    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66bc45fc97-b8kwb" event={"ID":"0dae4f31-8ea9-480a-881f-61bad1def6bc","Type":"ContainerStarted","Data":"99e1f978397ad7f650145477ce2aca2f469893aa3fae44bc7e84fcfada4b418f"}
Oct 30 21:23:12.020090 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.020069    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7659844d84-4hwr6" event={"ID":"8ecfcbcb-28ea-40cf-825b-5b01330c18e9","Type":"ContainerStarted","Data":"322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72"}
Oct 30 21:23:12.020190 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.020100    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7659844d84-4hwr6" event={"ID":"8ecfcbcb-28ea-40cf-825b-5b01330c18e9","Type":"ContainerStarted","Data":"c117e5da23d812319064ebe402a785391e922e428ef375b1067c386291417f14"}
Oct 30 21:23:12.020245 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.020183    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:12.021217 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.021198    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8" event={"ID":"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb","Type":"ContainerStarted","Data":"8cf8f7d0377ef4fec32c5869b67a9120b502a51b0b2498b48e5ceef81576a8ed"}
Oct 30 21:23:12.091415 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.091386    2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:12.094664 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.094643    2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:12.140304 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.140261    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/router-default-66bc45fc97-b8kwb" podStartSLOduration=378.140248676 podStartE2EDuration="6m18.140248676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:12.139612175 +0000 UTC m=+64.981419243" watchObservedRunningTime="2026-10-30 21:23:12.140248676 +0000 UTC m=+64.982055747"
Oct 30 21:23:12.226107 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.226083    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:12.262816 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.262754    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7659844d84-4hwr6" podStartSLOduration=55.26274097 podStartE2EDuration="55.26274097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:12.261358872 +0000 UTC m=+65.103165940" watchObservedRunningTime="2026-10-30 21:23:12.26274097 +0000 UTC m=+65.104548145"
Oct 30 21:23:12.614122 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.614084    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:12.673562 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.673522    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:12.673719 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.673570    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:23:12.725920 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.725881    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:23:12.726111 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.725992    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:23:12.746714 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.746571    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:12.747490 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.747455    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:23:12.803618 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.803529    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:12.808504 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.808479    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-jj5qw\""
Oct 30 21:23:12.817365 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.817051    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:12.825458 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.825436    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nr2gm\""
Oct 30 21:23:12.834806 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:12.834568    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:23:13.026628 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:13.026169    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:13.027722 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:13.027695    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:13.214194 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:13.210950    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4z6n"]
Oct 30 21:23:13.224299 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:23:13.224253    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5515bc6_8312_4be8_999c_9072fa30b526.slice/crio-0b4634955beca7a6aadb94c1583baad38a6041e9a788ef8fe348c6ef91bc8936 WatchSource:0}: Error finding container 0b4634955beca7a6aadb94c1583baad38a6041e9a788ef8fe348c6ef91bc8936: Status 404 returned error can't find the container with id 0b4634955beca7a6aadb94c1583baad38a6041e9a788ef8fe348c6ef91bc8936
Oct 30 21:23:13.264446 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:13.264362    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vps4x"]
Oct 30 21:23:13.268260 ip-10-0-136-135 kubenswrapper[2543]: W1030 21:23:13.268232    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c410c1_b967_4f7c_8478_ff14cd4696b3.slice/crio-809eb917b81584137c68e2532130a9db4b7ad49b75141b1b297cab7e92fbfdfc WatchSource:0}: Error finding container 809eb917b81584137c68e2532130a9db4b7ad49b75141b1b297cab7e92fbfdfc: Status 404 returned error can't find the container with id 809eb917b81584137c68e2532130a9db4b7ad49b75141b1b297cab7e92fbfdfc
Oct 30 21:23:14.032667 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:14.032586    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td" event={"ID":"7ade972d-dd5c-4128-bdd8-98647d69d3a8","Type":"ContainerStarted","Data":"af998c0b541f0ffe48dfaf3829137d582a0d91d0acf8d74cfa37d08784d48a72"}
Oct 30 21:23:14.034981 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:14.034932    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s4z6n" event={"ID":"a5515bc6-8312-4be8-999c-9072fa30b526","Type":"ContainerStarted","Data":"0b4634955beca7a6aadb94c1583baad38a6041e9a788ef8fe348c6ef91bc8936"}
Oct 30 21:23:14.037526 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:14.037500    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vps4x" event={"ID":"b9c410c1-b967-4f7c-8478-ff14cd4696b3","Type":"ContainerStarted","Data":"809eb917b81584137c68e2532130a9db4b7ad49b75141b1b297cab7e92fbfdfc"}
Oct 30 21:23:14.151909 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:14.150744    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td" podStartSLOduration=346.028602925 podStartE2EDuration="5m48.150724827s" totalImagesPullingTime="2.122121902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:14.150196568 +0000 UTC m=+66.992003644" watchObservedRunningTime="2026-10-30 21:23:14.150724827 +0000 UTC m=+66.992531907"
Oct 30 21:23:14.320576 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:14.320445    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:14.477424 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:14.477359    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:15.052128 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.052093    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7fr7k" event={"ID":"df296dbb-fcbc-44be-ac0d-9dc2c84481cc","Type":"ContainerStarted","Data":"d13a0245833a7c2092834561d3b22d06a115df09cd77d116104527d8e8355e10"}
Oct 30 21:23:15.052261 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.052160    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7fr7k" event={"ID":"df296dbb-fcbc-44be-ac0d-9dc2c84481cc","Type":"ContainerStarted","Data":"0a7d36d8fb63c9ee2406ea4443089a5dee28ff17196f51507bbc2e9bc9199004"}
Oct 30 21:23:15.052261 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.052204    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:15.056134 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.055542    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x" event={"ID":"a0747bf5-ca98-4d2c-9723-3c226817ee66","Type":"ContainerStarted","Data":"5c7c33426565936aa38abc66a8bc0b105ac81a04412c087ade75618b0e95fda3"}
Oct 30 21:23:15.056134 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.055599    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x" event={"ID":"a0747bf5-ca98-4d2c-9723-3c226817ee66","Type":"ContainerStarted","Data":"5559b49c5299330b9e4634693aafebbb115ebcdfb35ea1b65ec8978354c7c4c1"}
Oct 30 21:23:15.059282 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.058846    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8" event={"ID":"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb","Type":"ContainerStarted","Data":"8ee8d7d23efb2445e1433001242f9a820ecade0569b334e44e119ccccf15b5da"}
Oct 30 21:23:15.180162 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.178950    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-7fr7k" podStartSLOduration=34.297683082 podStartE2EDuration="37.178931008s" totalImagesPullingTime="2.881247926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:15.177649244 +0000 UTC m=+68.019456321" watchObservedRunningTime="2026-10-30 21:23:15.178931008 +0000 UTC m=+68.020738083"
Oct 30 21:23:15.295714 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.295610    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8" podStartSLOduration=378.505270971 podStartE2EDuration="6m21.295595452s" totalImagesPullingTime="2.790324481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:15.294525357 +0000 UTC m=+68.136332433" watchObservedRunningTime="2026-10-30 21:23:15.295595452 +0000 UTC m=+68.137402526"
Oct 30 21:23:15.412715 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.412655    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x" podStartSLOduration=378.724372635 podStartE2EDuration="6m21.412641315s" totalImagesPullingTime="2.68826868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:15.411667544 +0000 UTC m=+68.253474624" watchObservedRunningTime="2026-10-30 21:23:15.412641315 +0000 UTC m=+68.254448400"
Oct 30 21:23:15.542279 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.542233    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:15.692907 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.692876    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:15.846424 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:15.846389    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:16.065336 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:16.064836    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vps4x" event={"ID":"b9c410c1-b967-4f7c-8478-ff14cd4696b3","Type":"ContainerStarted","Data":"c78d5848b20e29fc0bdae868b60bacc0a8b5516acb0625173e952516fcee4798"}
Oct 30 21:23:16.065336 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:16.064893    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vps4x" event={"ID":"b9c410c1-b967-4f7c-8478-ff14cd4696b3","Type":"ContainerStarted","Data":"471a2abd058e8e3706080ea6260110eafc1c319b5c2294a00611f6dc59dbd493"}
Oct 30 21:23:16.181862 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:16.181805    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vps4x" podStartSLOduration=66.452474737 podStartE2EDuration="1m8.181790444s" totalImagesPullingTime="1.729315707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:16.181115706 +0000 UTC m=+69.022922782" watchObservedRunningTime="2026-10-30 21:23:16.181790444 +0000 UTC m=+69.023597538"
Oct 30 21:23:16.456198 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:16.456167    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:16.627395 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:16.627360    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:16.802992 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:16.802906    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:16.960210 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:16.960178    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:18.525520 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:18.525494    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:18.534578 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:18.534553    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:18.536915 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:18.536893    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:18.683723 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:18.683701    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:18.809493 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:18.809428    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5nrzq\""
Oct 30 21:23:18.818487 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:18.818462    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:18.892978 ip-10-0-136-135 kubenswrapper[2543]: I1030 21:23:18.892808    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:18.905667 ip-10-0-136-135 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 21:23:18.923401 ip-10-0-136-135 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 21:23:18.923572 ip-10-0-136-135 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 21:23:18.923619 ip-10-0-136-135 systemd[1]: kubelet.service: Consumed 4.238s CPU time.
Oct 30 21:23:18.936547 ip-10-0-136-135 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:23:19.039855 ip-10-0-136-135 kubenswrapper[5575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:23:19.039855 ip-10-0-136-135 kubenswrapper[5575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:23:19.039855 ip-10-0-136-135 kubenswrapper[5575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:23:19.040278 ip-10-0-136-135 kubenswrapper[5575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:23:19.042439 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042363    5575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:23:19.042439 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042439    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042444    5575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042447    5575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042450    5575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042453    5575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042455    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042458    5575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042461    5575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042464    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042467    5575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042469    5575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042472    5575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042474    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042477    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042480    5575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042482    5575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042485    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042487    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042490    5575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042493    5575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:23:19.042567 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042496    5575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042500    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042505    5575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042509    5575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042513    5575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042519    5575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042525    5575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042529    5575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042532    5575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042541    5575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042544    5575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042546    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042549    5575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042552    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042576    5575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042580    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042583    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042585    5575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042588    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:23:19.043104 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042590    5575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042593    5575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042596    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042598    5575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042602    5575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042605    5575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042608    5575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042611    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042614    5575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042616    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042619    5575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042622    5575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042625    5575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042627    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042630    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042633    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042635    5575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042638    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042641    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:23:19.043585 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042643    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042646    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042648    5575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042651    5575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042654    5575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042656    5575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042659    5575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042661    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042664    5575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042666    5575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042668    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042671    5575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042673    5575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042676    5575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042679    5575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042682    5575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042688    5575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042691    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042697    5575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:23:19.044074 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042700    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042703    5575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042707    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042710    5575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042713    5575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042715    5575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042718    5575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042720    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042723    5575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042725    5575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042728    5575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042730    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042733    5575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042735    5575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042738    5575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042740    5575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042743    5575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042745    5575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042747    5575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042750    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:23:19.044549 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042753    5575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042755    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042758    5575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042760    5575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042763    5575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042765    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042768    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.042770    5575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043604    5575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043613    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043616    5575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043620    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043622    5575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043625    5575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043630    5575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043632    5575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043638    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043641    5575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043643    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043646    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:23:19.045087 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043648    5575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043651    5575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043654    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043657    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043660    5575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043662    5575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043665    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043668    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043670    5575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043673    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043675    5575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043678    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043680    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043683    5575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043685    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043688    5575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043690    5575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043693    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043695    5575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043698    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:23:19.045592 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043700    5575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043702    5575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043705    5575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043708    5575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043710    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043713    5575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043717    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043719    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043722    5575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043725    5575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043728    5575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043730    5575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043733    5575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043735    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043738    5575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043740    5575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043743    5575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043745    5575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043748    5575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043750    5575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:23:19.046097 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043752    5575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043756    5575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043760    5575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043763    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043766    5575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043768    5575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043771    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043774    5575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043776    5575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043779    5575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043781    5575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043784    5575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043786    5575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043788    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043791    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043793    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043796    5575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043798    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043802    5575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043804    5575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:23:19.046599 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043807    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043809    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043812    5575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043815    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043817    5575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043820    5575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043822    5575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043825    5575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043827    5575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043830    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043832    5575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043834    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043837    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043840    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043842    5575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043844    5575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043847    5575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043849    5575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043852    5575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:23:19.047142 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043855    5575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043857    5575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043859    5575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043863    5575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043868    5575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043871    5575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043874    5575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043877    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043881    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043883    5575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043885    5575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043889    5575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043891    5575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043895    5575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.043898    5575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044426    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044433    5575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044436    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044439    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:23:19.047617 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044441    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044444    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044446    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044449    5575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044452    5575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044455    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044458    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044460    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044463    5575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044465    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044468    5575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044470    5575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044473    5575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044476    5575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044478    5575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044482    5575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044486    5575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044490    5575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044493    5575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:23:19.048134 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044496    5575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044498    5575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044501    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044503    5575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044506    5575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044509    5575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044512    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044514    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044517    5575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044519    5575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044522    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044525    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044527    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044530    5575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044532    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044535    5575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044537    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044539    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044542    5575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044544    5575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:23:19.048626 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044547    5575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044549    5575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044552    5575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044562    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044566    5575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044569    5575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044572    5575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044574    5575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044577    5575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044579    5575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044583    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044585    5575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044589    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044591    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044593    5575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044596    5575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044598    5575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044601    5575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044604    5575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044607    5575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:23:19.049145 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044611    5575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044614    5575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044617    5575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044620    5575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044623    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044626    5575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044628    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044630    5575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044633    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044635    5575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044638    5575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044640    5575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044642    5575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044645    5575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044647    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044650    5575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044652    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044654    5575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044657    5575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:23:19.049635 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044659    5575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044662    5575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044664    5575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044668    5575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044670    5575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044673    5575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044675    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044678    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044680    5575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044683    5575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044685    5575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044688    5575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044690    5575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044693    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044695    5575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044698    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044700    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044703    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044706    5575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044708    5575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:23:19.050129 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044711    5575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044713    5575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044716    5575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.044719    5575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044811    5575 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044821    5575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044831    5575 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044837    5575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044844    5575 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044847    5575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044852    5575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044856    5575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044859    5575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044862    5575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044865    5575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044870    5575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044873    5575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044876    5575 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044879    5575 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044882    5575 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044884    5575 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044887    5575 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044890    5575 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:23:19.050613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044893    5575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044896    5575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044899    5575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044903    5575 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044906    5575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044909    5575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044912    5575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044916    5575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044919    5575 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044922    5575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044924    5575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044927    5575 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044930    5575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044934    5575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044937    5575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044939    5575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044942    5575 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044945    5575 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044948    5575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044952    5575 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044955    5575 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044958    5575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044974    5575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044977    5575 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:23:19.051176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044982    5575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044985    5575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044988    5575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044991    5575 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044994    5575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.044996    5575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045000    5575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045002    5575 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045005    5575 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045008    5575 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045012    5575 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045016    5575 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045019    5575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045022    5575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045025    5575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045028    5575 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045031    5575 flags.go:64] FLAG: --help="false"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045034    5575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045037    5575 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045040    5575 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045043    5575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045046    5575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045049    5575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:23:19.051760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045052    5575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045055    5575 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045058    5575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045060    5575 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045063    5575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045066    5575 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045069    5575 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045072    5575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045075    5575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045079    5575 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045082    5575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045085    5575 flags.go:64] FLAG: --lock-file=""
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045087    5575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045090    5575 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045094    5575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045099    5575 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045102    5575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045105    5575 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045108    5575 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045112    5575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045116    5575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045119    5575 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045122    5575 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045126    5575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045129    5575 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:23:19.052325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045133    5575 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045136    5575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045139    5575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045142    5575 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045145    5575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045148    5575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045151    5575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045154    5575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045160    5575 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045164    5575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045167    5575 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045170    5575 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045172    5575 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045175    5575 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045178    5575 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045181    5575 flags.go:64] FLAG: --port="10250"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045185    5575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045188    5575 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0d21c4cca50b2ca51"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045191    5575 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045194    5575 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045197    5575 flags.go:64] FLAG: --register-node="true"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045200    5575 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045203    5575 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045206    5575 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045209    5575 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045212    5575 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:23:19.052986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045216    5575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045219    5575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045222    5575 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045225    5575 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045228    5575 flags.go:64] FLAG: --runonce="false"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045231    5575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045234    5575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045236    5575 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045247    5575 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045250    5575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045253    5575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045256    5575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045259    5575 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045262    5575 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045265    5575 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045268    5575 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045271    5575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045274    5575 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045277    5575 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045280    5575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045285    5575 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045288    5575 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045292    5575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045295    5575 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045298    5575 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:23:19.053634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045301    5575 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045303    5575 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045306    5575 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045309    5575 flags.go:64] FLAG: --v="2"
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045313    5575 flags.go:64] FLAG: --version="false"
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045317    5575 flags.go:64] FLAG: --vmodule=""
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045321    5575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045325    5575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045497    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045501    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045504    5575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045507    5575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045509    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045512    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045514    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045516    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045525    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045527    5575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045530    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045532    5575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045535    5575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:23:19.054253 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045537    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045540    5575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045542    5575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045545    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045547    5575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045550    5575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045558    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045561    5575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045565    5575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045567    5575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045570    5575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045572    5575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045575    5575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045577    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045580    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045583    5575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045585    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045588    5575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045591    5575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:23:19.054772 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045594    5575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045596    5575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045599    5575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045602    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045604    5575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045607    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045609    5575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045612    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045614    5575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045623    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045625    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045628    5575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045630    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045633    5575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045635    5575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045638    5575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045640    5575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045643    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045646    5575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:23:19.055391 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045650    5575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045652    5575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045656    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045658    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045661    5575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045663    5575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045665    5575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045668    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045670    5575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045673    5575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045675    5575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045678    5575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045681    5575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045684    5575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045687    5575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045689    5575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045692    5575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045696    5575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045699    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:23:19.056175 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045702    5575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045705    5575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045707    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045710    5575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045718    5575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045721    5575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045723    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045726    5575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045728    5575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045731    5575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045734    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045736    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045739    5575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045741    5575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045744    5575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045746    5575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045749    5575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045751    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045754    5575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045756    5575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:23:19.056928 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045759    5575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045762    5575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045764    5575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045766    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045769    5575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045773    5575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045775    5575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045778    5575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045780    5575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045783    5575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045786    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045788    5575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045791    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045793    5575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045796    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045798    5575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:23:19.057591 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.045824    5575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045876    5575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045881    5575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045884    5575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045887    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045890    5575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045892    5575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045895    5575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045897    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045900    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045902    5575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045904    5575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045907    5575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045909    5575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045912    5575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045915    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045917    5575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045919    5575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045922    5575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045925    5575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:23:19.058172 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045927    5575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045929    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045933    5575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045936    5575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045938    5575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045941    5575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045943    5575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045946    5575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045948    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045951    5575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045954    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045956    5575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045958    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045974    5575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045983    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045986    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045989    5575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045992    5575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045994    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.045997    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:23:19.058665 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046000    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046002    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046005    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046007    5575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046009    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046012    5575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046015    5575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046017    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046020    5575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046022    5575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046025    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046041    5575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046045    5575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046048    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046052    5575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046055    5575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046059    5575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046061    5575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046064    5575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046066    5575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:23:19.059173 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046069    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046072    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046075    5575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046077    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046080    5575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046083    5575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046085    5575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046094    5575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046098    5575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046100    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046103    5575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046106    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046108    5575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046111    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046114    5575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046116    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046118    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046121    5575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046124    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:23:19.059845 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046126    5575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046129    5575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046131    5575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046133    5575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046136    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046140    5575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046144    5575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046148    5575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046151    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046154    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046157    5575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046160    5575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046162    5575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046165    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046168    5575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046170    5575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046173    5575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046175    5575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046178    5575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:23:19.060568 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046180    5575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046183    5575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046192    5575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046198    5575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046203    5575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046207    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046210    5575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046213    5575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.046215    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.050131    5575 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.050147    5575 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.050164    5575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.050168    5575 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050224    5575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050228    5575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050232    5575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050234    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050237    5575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050240    5575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:23:19.061324 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050242    5575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050245    5575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050247    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050250    5575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050253    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050255    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050258    5575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050261    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050263    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050266    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050269    5575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050271    5575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050274    5575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050277    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050279    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050281    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050284    5575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050287    5575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050290    5575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:23:19.062325 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050292    5575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050295    5575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050297    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050300    5575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050303    5575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050306    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050308    5575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050311    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050313    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050316    5575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050318    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050321    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050323    5575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050326    5575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050329    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050331    5575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050334    5575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050336    5575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050338    5575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050341    5575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:23:19.063014 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050345    5575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050347    5575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050350    5575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050352    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050354    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050357    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050359    5575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050362    5575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050364    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050367    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050370    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050372    5575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050375    5575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050377    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050380    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050382    5575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050385    5575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050388    5575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050390    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:23:19.063609 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050393    5575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050395    5575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050398    5575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050400    5575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050402    5575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050405    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050407    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050410    5575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050412    5575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050414    5575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050417    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050419    5575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050422    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050425    5575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050427    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050429    5575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050432    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050434    5575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050437    5575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050440    5575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:23:19.064155 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050443    5575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050445    5575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050448    5575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050450    5575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050453    5575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050455    5575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050458    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050460    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050464    5575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050468    5575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050471    5575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050479    5575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050482    5575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050485    5575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050487    5575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050490    5575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050492    5575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050495    5575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050498    5575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050500    5575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:23:19.064728 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050502    5575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050507    5575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.050535    5575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050707    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050711    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050714    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050717    5575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050720    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050722    5575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050725    5575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050727    5575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050730    5575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050732    5575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050735    5575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050737    5575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:23:19.065464 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050739    5575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050742    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050745    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050747    5575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050750    5575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050752    5575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050754    5575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050757    5575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050759    5575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050767    5575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050770    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050773    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050775    5575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050777    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050780    5575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050782    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050785    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050787    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050790    5575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050792    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:23:19.065940 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050795    5575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050797    5575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050800    5575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050802    5575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050804    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050807    5575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050809    5575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050813    5575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050816    5575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050819    5575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050822    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050824    5575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050827    5575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050829    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050832    5575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050834    5575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050837    5575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050842    5575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050844    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050846    5575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:23:19.066525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050849    5575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050851    5575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050859    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050862    5575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050865    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050867    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050869    5575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050872    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050874    5575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050876    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050879    5575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050881    5575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050884    5575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050886    5575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050889    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050891    5575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050893    5575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050897    5575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:23:19.067111 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050901    5575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050903    5575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050906    5575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050909    5575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050911    5575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050913    5575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050921    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050924    5575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050926    5575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050929    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050931    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050935    5575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050938    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050940    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050942    5575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050945    5575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050947    5575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050955    5575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050958    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050960    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:23:19.067602 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050987    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050990    5575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050993    5575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050996    5575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.050998    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051001    5575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051004    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051006    5575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051008    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051011    5575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051014    5575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051016    5575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051018    5575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051021    5575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051023    5575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051026    5575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:23:19.068123 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.051050    5575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051088    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051092    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051095    5575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051098    5575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051102    5575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051105    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051110    5575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051113    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051115    5575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051118    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051120    5575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051123    5575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051125    5575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051134    5575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051136    5575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051139    5575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051141    5575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051144    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051147    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:23:19.068517 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051149    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051151    5575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051155    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051157    5575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051160    5575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051162    5575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051164    5575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051167    5575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051169    5575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051172    5575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051174    5575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051177    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051179    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051182    5575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051185    5575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051187    5575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051190    5575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051192    5575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051195    5575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051198    5575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:23:19.069023 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051201    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051203    5575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051205    5575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051208    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051210    5575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051213    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051215    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051225    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051227    5575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051230    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051232    5575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051235    5575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051237    5575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051239    5575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051242    5575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051244    5575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051246    5575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051250    5575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051254    5575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:23:19.069525 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051257    5575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051259    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051262    5575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051264    5575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051267    5575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051269    5575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051271    5575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051274    5575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051276    5575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051278    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051281    5575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051283    5575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051286    5575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051288    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051291    5575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051293    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051295    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051298    5575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051300    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:23:19.070002 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051303    5575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051305    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051313    5575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051316    5575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051318    5575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051320    5575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051323    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051325    5575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051328    5575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051331    5575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051335    5575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051337    5575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051340    5575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051342    5575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051345    5575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051347    5575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051350    5575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051352    5575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051354    5575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:23:19.070515 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051357    5575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051359    5575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051362    5575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051364    5575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051366    5575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051369    5575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051372    5575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051374    5575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051377    5575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.051379    5575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.051449    5575 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.052428    5575 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.052481    5575 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.052680    5575 server.go:1014] "Starting client certificate rotation"
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.052886    5575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.053011    5575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:17:08 +0000 UTC" deadline="2028-07-26 15:06:46.992249642 +0000 UTC"
Oct 30 21:23:19.070993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.053076    5575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15233h43m27.939175765s"
Oct 30 21:23:19.071433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.053293    5575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:23:19.071433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.054491    5575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:23:19.071433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.057566    5575 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:23:19.071433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.059436    5575 log.go:25] "Validated CRI v1 image API"
Oct 30 21:23:19.071433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.062959    5575 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:23:19.071433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.065258    5575 fs.go:135] Filesystem UUIDs: map[5aa3fe11-8ec0-4514-b69d-f68c6c24f883:/dev/nvme0n1p4 639423a0-3bd7-4e2a-bc17-7f1772c0252e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 21:23:19.071610 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.065278    5575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/08135341690f79cf38e4a486c8719672f762267b9f9635a765706e16f1685f0a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/08135341690f79cf38e4a486c8719672f762267b9f9635a765706e16f1685f0a/userdata/shm major:0 minor:226 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/08d11690d865dc79a5ea3cfc3ad679ba2d6a5191264b2fe8757364f4d3dca048/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/08d11690d865dc79a5ea3cfc3ad679ba2d6a5191264b2fe8757364f4d3dca048/userdata/shm major:0 minor:287 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0b4634955beca7a6aadb94c1583baad38a6041e9a788ef8fe348c6ef91bc8936/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0b4634955beca7a6aadb94c1583baad38a6041e9a788ef8fe348c6ef91bc8936/userdata/shm major:0 minor:389 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0cc85c1ed36232ce5e9b7c84aa202701d1ebff7ad6db003a7e352af983f6c949/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0cc85c1ed36232ce5e9b7c84aa202701d1ebff7ad6db003a7e352af983f6c949/userdata/shm major:0 minor:357 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/126dde09b6b61e3178615ee48df1b3faa265973355d46d408097ad8519c5495b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/126dde09b6b61e3178615ee48df1b3faa265973355d46d408097ad8519c5495b/userdata/shm major:0 minor:213 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1ebd0b165e2c9e9b195e597b658e48acc61a0abfa9e1036b0c521e6b08bb58c6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1ebd0b165e2c9e9b195e597b658e48acc61a0abfa9e1036b0c521e6b08bb58c6/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/205b7f1f571d14a8f325e7fefc350340a8315cd3f4a6f29c86c2f70fa80cdf47/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/205b7f1f571d14a8f325e7fefc350340a8315cd3f4a6f29c86c2f70fa80cdf47/userdata/shm major:0 minor:444 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2ddd9e3718a9ca803e5295740438bd22a6137393f9e2c01e094be5bed6b62856/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2ddd9e3718a9ca803e5295740438bd22a6137393f9e2c01e094be5bed6b62856/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/32f3f34942f80b4fc656dda1ee653c4f26ad6ca4f094bcbb9c7578a9c5fc301c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/32f3f34942f80b4fc656dda1ee653c4f26ad6ca4f094bcbb9c7578a9c5fc301c/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/408c940f390e9a3d5655b0ab46ca761c1b191efe2e7c2aa6a07d06e6a3b51e6f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/408c940f390e9a3d5655b0ab46ca761c1b191efe2e7c2aa6a07d06e6a3b51e6f/userdata/shm major:0 minor:351 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/411f593ca59e307403fbfe8c0486962149536921600f7894a786621e329dee04/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/411f593ca59e307403fbfe8c0486962149536921600f7894a786621e329dee04/userdata/shm major:0 minor:63 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/45e3498274ac8c535a804bfd4c3f5a3f947344734b83274266473a12d494c60d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/45e3498274ac8c535a804bfd4c3f5a3f947344734b83274266473a12d494c60d/userdata/shm major:0 minor:79 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4719dd5a254d29d65621a9acf38fc6cece137d43ffd79ef25726ad4130359ece/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4719dd5a254d29d65621a9acf38fc6cece137d43ffd79ef25726ad4130359ece/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6a16b8bcb0c04e38e3802c062bafc0373e7be3e531e33a78e3c68182d3c1c465/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6a16b8bcb0c04e38e3802c062bafc0373e7be3e531e33a78e3c68182d3c1c465/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6f2a54f91e38ab7a6bd32cf9bd4d5451c3cf76dc353b45fd7184a957e7f4b55a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6f2a54f91e38ab7a6bd32cf9bd4d5451c3cf76dc353b45fd7184a957e7f4b55a/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/74bc8edbf0633a2bb226c5ad5ecd03561b6ca4f84052268ddecbac6a9b3a93f4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/74bc8edbf0633a2bb226c5ad5ecd03561b6ca4f84052268ddecbac6a9b3a93f4/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7f32e10773558ebef4e646177d54c856be053857aebd830aa040071602113175/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7f32e10773558ebef4e646177d54c856be053857aebd830aa040071602113175/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/809eb917b81584137c68e2532130a9db4b7ad49b75141b1b297cab7e92fbfdfc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/809eb917b81584137c68e2532130a9db4b7ad49b75141b1b297cab7e92fbfdfc/userdata/shm major:0 minor:391 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/833dab624c0785600333f95b5d4a9914e1bb57e7c6226232b25aea6390bb0bcd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/833dab624c0785600333f95b5d4a9914e1bb57e7c6226232b25aea6390bb0bcd/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/855d815d22495e18c1befba8c75560ae9983b8459aab715138cc70c8286b4581/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/855d815d22495e18c1befba8c75560ae9983b8459aab715138cc70c8286b4581/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/88e3eca136b571a6f05b7ff58fdf07b2810178d981214344276d32cef01e0118/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/88e3eca136b571a6f05b7ff58fdf07b2810178d981214344276d32cef01e0118/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8cf8f7d0377ef4fec32c5869b67a9120b502a51b0b2498b48e5ceef81576a8ed/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8cf8f7d0377ef4fec32c5869b67a9120b502a51b0b2498b48e5ceef81576a8ed/userdata/shm major:0 minor:347 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8d80326ad1588cb52a3437536457829135aafa79deab8a6eedba50e03a51a17b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8d80326ad1588cb52a3437536457829135aafa79deab8a6eedba50e03a51a17b/userdata/shm major:0 minor:335 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9198c4bb29241f690e2e12c5f7b8555d0fedfc6399c756b2609919ffb2b600fd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9198c4bb29241f690e2e12c5f7b8555d0fedfc6399c756b2609919ffb2b600fd/userdata/shm major:0 minor:229 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/99e1f978397ad7f650145477ce2aca2f469893aa3fae44bc7e84fcfada4b418f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/99e1f978397ad7f650145477ce2aca2f469893aa3fae44bc7e84fcfada4b418f/userdata/shm major:0 minor:349 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b69c6a2460fb985f25490237971cdb1e4f78953b75a9b1f7ac2c9528e8fb1d36/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b69c6a2460fb985f25490237971cdb1e4f78953b75a9b1f7ac2c9528e8fb1d36/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b8e7b34c90abddc1961c748b822216734a01e82bf0cf9dd3823c751416a91dd1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b8e7b34c90abddc1961c748b822216734a01e82bf0cf9dd3823c751416a91dd1/userdata/shm major:0 minor:353 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c117e5da23d812319064ebe402a785391e922e428ef375b1067c386291417f14/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c117e5da23d812319064ebe402a785391e922e428ef375b1067c386291417f14/userdata/shm major:0 minor:355 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ed6eb69243a6015f118d16cdd86b43ba54733a08b946f7e413fa35608c608b04/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ed6eb69243a6015f118d16cdd86b43ba54733a08b946f7e413fa35608c608b04/userdata/shm major:0 minor:218 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/efeeb148cce4ca1b9ed2689a1996a7bc599bb97394aac89ce8c6d32aed3489ef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/efeeb148cce4ca1b9ed2689a1996a7bc599bb97394aac89ce8c6d32aed3489ef/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f7f31624c71b21638eb1c6b0da90d1855722588ac6e35b651c53eb994d5b7281/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f7f31624c71b21638eb1c6b0da90d1855722588ac6e35b651c53eb994d5b7281/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f/volumes/kubernetes.io~projected/kube-api-access-jpjm4:{mountpoint:/var/lib/kubelet/pods/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f/volumes/kubernetes.io~projected/kube-api-access-jpjm4 major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~projected/kube-api-access-h4qvr:{mountpoint:/var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~projected/kube-api-access-h4qvr major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~secret/default-certificate major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~secret/metrics-certs major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~secret/stats-auth major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1737ddb3-e512-4944-8aad-94fac75a3a7e/volumes/kubernetes.io~projected/kube-api-access-d4cxm:{mountpoint:/var/lib/kubelet/pods/1737ddb3-e512-4944-8aad-94fac75a3a7e/volumes/kubernetes.io~projected/kube-api-access-d4cxm major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/204ffe78-eee5-4cf4-9eb3-23a4034a26af/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/204ffe78-eee5-4cf4-9eb3-23a4034a26af/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/204ffe78-eee5-4cf4-9eb3-23a4034a26af/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/204ffe78-eee5-4cf4-9eb3-23a4034a26af/volumes/kubernetes.io~empty-dir/tmp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/204ffe78-eee5-4cf4-9eb3-23a4034a26af/volumes/kubernetes.io~projected/kube-api-access-d57sr:{mountpoint:/var/lib/kubelet/pods/204ffe78-eee5-4cf4-9eb3-23a4034a26af/volumes/kubernetes.io~projected/kube-api-access-d57sr major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23e2e6b5-2a6a-4d14-ad7a-784442fd6960/volumes/kubernetes.io~projected/kube-api-access-r4q8k:{mountpoint:/var/lib/kubelet/pods/23e2e6b5-2a6a-4d14-ad7a-784442fd6960/volumes/kubernetes.io~projected/kube-api-access-r4q8k major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23e2e6b5-2a6a-4d14-ad7a-784442fd6960/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/23e2e6b5-2a6a-4d14-ad7a-784442fd6960/volumes/kubernetes.io~secret/serving-cert major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2523fa7a-1747-4695-a737-5c2a1caf2864/volumes/kubernetes.io~projected/kube-api-access-4rcbl:{mountpoint:/var/lib/kubelet/pods/2523fa7a-1747-4695-a737-5c2a1caf2864/volumes/kubernetes.io~projected/kube-api-access-4rcbl major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/32575811-fcf4-4bcd-beb3-6bc4f0d472bd/volumes/kubernetes.io~projected/kube-api-access-wjzq2:{mountpoint:/var/lib/kubelet/pods/32575811-fcf4-4bcd-beb3-6bc4f0d472bd/volumes/kubernetes.io~projected/kube-api-access-wjzq2 major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39c99098-aa34-4200-b2a4-2404ae1cd454/volumes/kubernetes.io~projected/kube-api-access-gsvhv:{mountpoint:/var/lib/kubelet/pods/39c99098-aa34-4200-b2a4-2404ae1cd454/volumes/kubernetes.io~projected/kube-api-access-gsvhv major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39c99098-aa34-4200-b2a4-2404ae1cd454/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/39c99098-aa34-4200-b2a4-2404ae1cd454/volumes/kubernetes.io~secret/serving-cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534/volumes/kubernetes.io~projected/kube-api-access-nxl2t:{mountpoint:/var/lib/kubelet/pods/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534/volumes/kubernetes.io~projected/kube-api-access-nxl2t major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64cf3434-1c3d-4036-9a55-4eb3958b16d4/volumes/kubernetes.io~projected/kube-api-access-8bh79:{mountpoint:/var/lib/kubelet/pods/64cf3434-1c3d-4036-9a55-4eb3958b16d4/volumes/kubernetes.io~projected/kube-api-access-8bh79 major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64cf3434-1c3d-4036-9a55-4eb3958b16d4/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/64cf3434-1c3d-4036-9a55-4eb3958b16d4/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:438 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2/volumes/kubernetes.io~projected/kube-api-access-8m67j:{mountpoint:/var/lib/kubelet/pods/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2/volumes/kubernetes.io~projected/kube-api-access-8m67j major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7026bee2-54f0-43f2-aaeb-b7c81acd5e68/volumes/kubernetes.io~projected/kube-api-access-5z6nn:{mountpoint:/var/lib/kubelet/pods/7026bee2-54f0-43f2-aaeb-b7c81acd5e68/volumes/kubernetes.io~projected/kube-api-access-5z6nn major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/760c893e-a6be-4c31-ad76-c1922d08a5d4/volumes/kubernetes.io~projected/kube-api-access-mjs68:{mountpoint:/var/lib/kubelet/pods/760c893e-a6be-4c31-ad76-c1922d08a5d4/volumes/kubernetes.io~projected/kube-api-access-mjs68 major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7735f8ec-f901-4584-b995-6f5b4bb14a79/volumes/kubernetes.io~projected/kube-api-access-74l2w:{mountpoint:/var/lib/kubelet/pods/7735f8ec-f901-4584-b995-6f5b4bb14a79/volumes/kubernetes.io~projected/kube-api-access-74l2w major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ade972d-dd5c-4128-bdd8-98647d69d3a8/volumes/kubernetes.io~secret/networking-console-plugin-cert:{mountpoint:/var/lib/kubelet/pods/7ade972d-dd5c-4128-bdd8-98647d69d3a8/volumes/kubernetes.io~secret/networking-console-plugin-cert major:0 minor:240 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f630f6b-6df2-4c78-9aff-8f2577cfb56c/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/7f630f6b-6df2-4c78-9aff-8f2577cfb56c/volumes/kubernetes.io~secret/agent-certs major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/822b5a15-b6cd-4106-b4c7-76ae8d6db19a/volumes/kubernetes.io~projected/kube-api-access-4gwjc:{mountpoint:/var/lib/kubelet/pods/822b5a15-b6cd-4106-b4c7-76ae8d6db19a/volumes/kubernetes.io~projected/kube-api-access-4gwjc major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:238 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~projected/kube-api-access-jf2dx:{mountpoint:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~projected/kube-api-access-jf2dx major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~projected/registry-tls:{mountpoint:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~projected/registry-tls major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a0747bf5-ca98-4d2c-9723-3c226817ee66/volumes/kubernetes.io~projected/kube-api-access-vwb8w:{mountpoint:/var/lib/kubelet/pods/a0747bf5-ca98-4d2c-9723-3c226817ee66/volumes/kubernetes.io~projected/kube-api-access-vwb8w major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a0747bf5-ca98-4d2c-9723-3c226817ee66/volumes/kubernetes.io~secret/samples-operator-tls:{mountpoint:/var/lib/kubelet/pods/a0747bf5-ca98-4d2c-9723-3c226817ee66/volumes/kubernetes.io~secret/samples-operator-tls major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5515bc6-8312-4be8-999c-9072fa30b526/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/a5515bc6-8312-4be8-999c-9072fa30b526/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:388 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5816f96-8b2e-4f04-a675-500b2a4044df/volumes/kubernetes.io~projected/kube-api-access-swsv4:{mountpoint:/var/lib/kubelet/pods/a5816f96-8b2e-4f04-a675-500b2a4044df/volumes/kubernetes.io~projected/kube-api-access-swsv4 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5d11da4-5f47-4bba-bc30-54df80304964/volumes/kubernetes.io~projected/kube-api-access-9f7qj:{mountpoint:/var/lib/kubelet/pods/a5d11da4-5f47-4bba-bc30-54df80304964/volumes/kubernetes.io~projected/kube-api-access-9f7qj major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b5fef5d7-aeae-4377-b42a-18ca1db1aef4/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/b5fef5d7-aeae-4377-b42a-18ca1db1aef4/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b5fef5d7-aeae-4377-b42a-18ca1db1aef4/volumes/kubernetes.io~projected/kube-api-access-9hg5t:{mountpoint:/var/lib/kubelet/pods/b5fef5d7-aeae-4377-b42a-18ca1db1aef4/volumes/kubernetes.io~projected/kube-api-access-9hg5t major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b5fef5d7-aeae-4377-b42a-18ca1db1aef4/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/b5fef5d7-aeae-4377-b42a-18ca1db1aef4/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9c410c1-b967-4f7c-8478-ff14cd4696b3/volumes/kubernetes.io~projected/kube-api-access-cjh4n:{mountpoint:/var/lib/kubelet/pods/b9c410c1-b967-4f7c-8478-ff14cd4696b3/volumes/kubernetes.io~projected/kube-api-access-cjh4n major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9c410c1-b967-4f7c-8478-ff14cd4696b3/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/b9c410c1-b967-4f7c-8478-ff14cd4696b3/volumes/kubernetes.io~secret/metrics-certs major:0 minor:383 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db22bba6-c4a6-4ff0-8c60-60f0c4e61864/volumes/kubernetes.io~projected/kube-api-access-mszds:{mountpoint:/var/lib/kubelet/pods/db22bba6-c4a6-4ff0-8c60-60f0c4e61864/volumes/kubernetes.io~projected/kube-api-access-mszds major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db22bba6-c4a6-4ff0-8c60-60f0c4e61864/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/db22bba6-c4a6-4ff0-8c60-60f0c4e61864/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df296dbb-fcbc-44be-ac0d-9dc2c84481cc/volumes/kubernetes.io~projected/kube-api-access-hw2bl:{mountpoint:/var/lib/kubelet/pods/df296dbb-fcbc-44be-ac0d-9dc2c84481cc/volumes/kubernetes.io~projected/kube-api-access-hw2bl major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df296dbb-fcbc-44be-ac0d-9dc2c84481cc/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/df296dbb-fcbc-44be-ac0d-9dc2c84481cc/volumes/kubernetes.io~secret/metrics-tls major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/volumes/kubernetes.io~projected/kube-api-access-t8l2r:{mountpoint:/var/lib/kubelet/pods/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/volumes/kubernetes.io~projected/kube-api-access-t8l2r major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7b27302-be59-4dc9-8e64-0ea2b2f4baa2/volumes/kubernetes.io~projected/kube-api-access-wlqdc:{mountpoint:/var/lib/kubelet/pods/e7b27302-be59-4dc9-8e64-0ea2b2f4baa2/volumes/kubernetes.io~projected/kube-api-access-wlqdc major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb9de1fa-933d-49a5-84ed-2418c40eead3/volumes/kubernetes.io~projected/kube-api-access-6lqls:{mountpoint:/var/lib/kubelet/pods/eb9de1fa-933d-49a5-84ed-2418c40eead3/volumes/kubernetes.io~projected/kube-api-access-6lqls major:0 minor:239 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb9de1fa-933d-49a5-84ed-2418c40eead3/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/eb9de1fa-933d-49a5-84ed-2418c40eead3/volumes/kubernetes.io~secret/cert major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb/volumes/kubernetes.io~projected/kube-api-access-tvqhl:{mountpoint:/var/lib/kubelet/pods/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb/volumes/kubernetes.io~projected/kube-api-access-tvqhl major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls:{mountpoint:/var/lib/kubelet/pods/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls major:0 minor:225 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/fe93ae2b5eb64ce8ce96c825735d785cf0d6794020b388cc773066754613bf07/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/2d1168f556f532213ae1470d1be661959653a7ddee39f4604a128b29a8ed69cc/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/7df6fe8fc68aeb294b80cd378d121611c51c91390cdb9304b027eb58a50d2d9d/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/4267426c06c67403761a01095afd04b979db771a4d7a092d5b433a276a0ee9e1/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/66d1b35ac3e2de945c31f4170fd6f6564468f5a0f513851956aceb3b82448b9a/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-116:{mountpoint:/var/lib/containers/storage/overlay/33d60e5abd65a71e9fb8ca7d1580bcfc7457603523936d4b1604069531df5024/merged major:0 minor:116 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/05441317eae1427b92966c8f396a7b4afa3849c4adb8fcbf26301839de805e28/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/4967ad1537ecaa2e88dbb3cc8dcff7c131fd3fc88f904ff944b0fa849dd4bb86/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/98a76ec8839b9a00208ede3b09080d93e7953f5c1bef70c875341075b2eb96c1/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/1fff812e12b1652a1dba68523c5b3eca22c6de2f295145df9c479ba3850b27db/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/63c97dec2dc8eab011cb434934619de7bb1a63f5fc66900aeddebf4aa7976406/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/6ecbc3fe5d8ef7d9482f107884d41d17a15988a11d7256f3ac662f6e3dda2faf/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/eb7edebd09b304706482549fba1b2cb9cc03d1efbc91c066d30750c6e50bc784/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/58014ebd5d2e4b2b21cd3c08b695f11eaf53104ae2e8c28c09c791d6be254b30/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/cb5129759d7bbe913c8dea64aff1679805a16c9682053fb091636c206154d3f5/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/05188df63f7474aa4306149afe2e1a5cdd948f64fb71b419a6e7f98a026e9dce/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/58d46d489bea9e7a469a96abcd6674fdae9a1cb28a018346db1da3d91dc1db5f/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/279d5cddac9906009fdfc102cd20f9d816d8a10ac86f0ce5ee6faf9d577a885f/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/c92896f4aaddc1cacfdaa3e1a37e3760e156ed9882b99cc4b8579b5f579decdf/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/eed390e57026fe9b824eb681479a7ae0f3550b70f687a59a31dd1ac22373f06d/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/19eabbe1351a8f6e1fd4c9a6f7569c188acbda1f73ae182298bd73d1fba86024/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/66bc619cfd257625017d9462ad3bb01f7538a950edfcfcf3e3918b5e62661a3f/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/cff7dd35c047e8c029f3d0f257bb2ad9e00f4257eb4cbc062a7b8501fd2761b8/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/09e3b29e62367fb32ea1ec04426d3dae3371013d926c66b17de96c58a66a199e/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/489e4de7f4540785ceb6a0068bf3be78bc9fa9f5fbb4d2f369087129e70f0a15/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/86431e4d57d3cf5bfd0de79b78afe45a01e5ee005451c4741275062bc12cb323/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/e3f5275be3c835c635f49edb99472725a31e07d7106f73d9fd43325f912176ad/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/8d269d9aee18a102437ddfdb18c27a1d4de6116ae5c7e7d417e449c3450c2e0b/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/10faa5225e5ac63a9dcb64b75b3d0cd5fc730406a6f119358553b51a37ed2f8a/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/f59142bf1a5235f5fb33812068725bfdc41ce90774838f628e7f98bf48f54892/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/2931dc0b154b4fb058c59f0f29450d83bfc345209c5ab665b57cc03555f0e655/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/60fadeaaa526a7fa76c06a0c832c9559ec97998cc821e52e75a228c387424537/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/9393da4c47120c0234fbd15ad72f8d29bbbd075fd6d241d702bf0661dfe5920a/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/d0eb9b7718fb277b60a362996bf56e6d665ce765046ac9fa5bd45d2568fba38f/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/442befe9ee8dac1931992d00683359520314fc24e3f98e2d2bb663e26c99aae7/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-291:{mountpoint:/var/lib/containers/storage/overlay/f63aba0aa5bf5733e8f3a074bf0e020e3fcb57ae6790668262afd2a14e756e13/merged major:0 minor:291 fsType:overlay blockSize:0} overlay_0-293:{mountpoint:/var/lib/containers/storage/overlay/2ba33c9b28442d176da6307885ade596c93547ac4359c6b78912e61fb4892689/merged major:0 minor:293 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/2adc77f891a257c05776dde6efff940727a72a2126e9e65db901fd5b2426dcfb/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/3e6e1e6eaa1c2213d28976c1061736819c75f388abb9a002528a23fe58355c94/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-303:{mountpoint:/var/lib/containers/storage/overlay/a798a2b58b71e7657ead151bfb7d442e1907fb9cef156570c314df1492c334b3/merged major:0 minor:303 fsType:overlay blockSize:0} overlay_0-309:{mountpoint:/var/lib/containers/storage/overlay/47b45acdd199e284146cdd5c1e8589be8840304666b5d99d9a48c87f19f819bc/merged major:0 minor:309 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/3c6ac85108ac66a271ff81296f62fef1c6626d33bd1d8fa658068022f4491860/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/e0fc2d740705a79871085f7f0f79344a73e91712d86fe7c84d3af1df8c0cadab/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/45152e8e51a35e3fafb4bbb45fbdbe60772538d6b11a60287c6cee679159a732/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/ed1640530869853b3d1d313b3b12bb4d7f91cefc4bb626ce1443df3be26cc9d3/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/5a87200f1ac85b4cae9be816fc9f399bda7e3dfefd4519d28e7da2bbc711c65d/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/74d1867faee4ad19f7790e570acbb9f2e7af2432b9aa14d115a3387dda652909/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/388135660eca1e39b539038d0f9fd3fa6e426c94e176c7fc997214c9921761a8/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/b6b42ff61759290b1018cc902955120d3e58e2972949e14c4a2c6a26d1c842a0/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-372:{mountpoint:/var/lib/containers/storage/overlay/8dfb4e84df5debb13f172820bdad34a1fda5d5fb675b5fd3bfd025548c82b247/merged major:0 minor:372 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/b3693116f27ec94d0ebbc26b1ced00569ca5ffa84b462011cea4deb358e1c773/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-381:{mountpoint:/var/lib/containers/storage/overlay/15e19360d20b73789d2ced9928430adfd53746b7bd91e668fef8b255fd551ee2/merged major:0 minor:381 fsType:overlay blockSize:0} overlay_0-393:{mountpoint:/var/lib/containers/storage/overlay/049ee42b74f4bb8a43961b1601ee509bbb5acd8f21b9ccc998f4bc89284e13bb/merged major:0 minor:393 fsType:overlay blockSize:0} overlay_0-395:{mountpoint:/var/lib/containers/storage/overlay/d452e1df72b8d0f74bef060929f2799bb910f4d98381db82d7a23dbf849e86ee/merged major:0 minor:395 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/9f542e656171a7f9c40d8ee5c8203a5f63d319ae312544bd64b51bbefd97887e/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-399:{mountpoint:/var/lib/containers/storage/overlay/bb027a7a53dfbc52e5554be50a64b50518c7b7ec101756de2193eac5fef37fff/merged major:0 minor:399 fsType:overlay blockSize:0} overlay_0-405:{mountpoint:/var/lib/containers/storage/overlay/327bda6474f1075863a552f200c5439de9ec63c397e99f3a507507b4fd68c507/merged major:0 minor:405 fsType:overlay blockSize:0} overlay_0-407:{mountpoint:/var/lib/containers/storage/overlay/5ed52c9599b453d6d9cbd389218b424142eae7d31dd3227d0d88bbf0ea252685/merged major:0 minor:407 fsType:overlay blockSize:0} overlay_0-416:{mountpoint:/var/lib/containers/storage/overlay/ae6d9eafe200a273cbd8b6b976c67ce32ccaf679cfcd24a327d14ff7274aa36e/merged major:0 minor:416 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/38d93e66cd16189efc54317ec15e48165b7ea051c1a20b5847b0cae608129142/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/f95f0368b88fd4aa747dbcb07bee30d628dbbeeec4134bbfaa3f2b57e0e3cac0/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/21fd04e9c7e4c77054cc8489ff311512fa894672539e2797ec74755f78ac03ec/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-442:{mountpoint:/var/lib/containers/storage/overlay/2a3dc3a1f3f60ffa568a7f52809a9c3dbcb9afd88b79ece49e5f2b7f2cfc6e58/merged major:0 minor:442 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/ebb557e3de317ef5ce357bef3317981210f51fcf0a6513ec5136cb6972dc2f6d/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/d5cd83e33f543e04d86ff235fe214d931ce44985ca893197315bc180a6b10812/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/e8ba7dd65657dc4208bf776a063bff708163fd5812385d96ffe6571bf8edfc04/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/ad00c0e468976df092c434fada90a90ea27217557ea726af7f99fd2b9031c7af/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/d1d1bac678ff0bd6ee04b90b4ef1d8fbffc4c787c41c86808533420722f8aa0b/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/b840cf342d284e08d6b1c7254ba27054dbf826eb2ddcdf8a9e00d7a3deea7ac0/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/c26bc2a464fc13b74f3466a47f1bf9aa3b7f5fc852d396d94277b39176299648/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/7fde13e27034cafb1c4ea13b69fa594b8d8290a478b8a985fc04cd62ecbefae3/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/c318b7279cb723771d506a2d160e22c1de618ba42e24530910a4e138a4ac3859/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/c273757f57390c820919a3f7f0f28abc28ac0ff112601a0e0e3634f570b56736/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 21:23:19.074088 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.073686    5575 manager.go:217] Machine: {Timestamp:2026-10-30 21:23:19.073200035 +0000 UTC m=+0.105048562 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3132228 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f3fea266c5c54f0f2ba1fc59f9914 SystemUUID:ec2f3fea-266c-5c54-f0f2-ba1fc59f9914 BootID:a3f38f2b-9542-48f1-bb21-a57a839ab1c4 Filesystems:[{Device:/run/containers/storage/overlay-containers/411f593ca59e307403fbfe8c0486962149536921600f7894a786621e329dee04/userdata/shm DeviceMajor:0 DeviceMinor:63 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7f32e10773558ebef4e646177d54c856be053857aebd830aa040071602113175/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:224 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/99e1f978397ad7f650145477ce2aca2f469893aa3fae44bc7e84fcfada4b418f/userdata/shm DeviceMajor:0 DeviceMinor:349 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/822b5a15-b6cd-4106-b4c7-76ae8d6db19a/volumes/kubernetes.io~projected/kube-api-access-4gwjc DeviceMajor:0 DeviceMinor:54 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/45e3498274ac8c535a804bfd4c3f5a3f947344734b83274266473a12d494c60d/userdata/shm DeviceMajor:0 DeviceMinor:79 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/08d11690d865dc79a5ea3cfc3ad679ba2d6a5191264b2fe8757364f4d3dca048/userdata/shm DeviceMajor:0 DeviceMinor:287 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-372 DeviceMajor:0 DeviceMinor:372 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-381 DeviceMajor:0 DeviceMinor:381 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-442 DeviceMajor:0 DeviceMinor:442 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a5816f96-8b2e-4f04-a675-500b2a4044df/volumes/kubernetes.io~projected/kube-api-access-swsv4 DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1737ddb3-e512-4944-8aad-94fac75a3a7e/volumes/kubernetes.io~projected/kube-api-access-d4cxm DeviceMajor:0 DeviceMinor:237 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/df296dbb-fcbc-44be-ac0d-9dc2c84481cc/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:341 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/408c940f390e9a3d5655b0ab46ca761c1b191efe2e7c2aa6a07d06e6a3b51e6f/userdata/shm DeviceMajor:0 DeviceMinor:351 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/39c99098-aa34-4200-b2a4-2404ae1cd454/volumes/kubernetes.io~projected/kube-api-access-gsvhv DeviceMajor:0 DeviceMinor:212 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-291 DeviceMajor:0 DeviceMinor:291 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/df296dbb-fcbc-44be-ac0d-9dc2c84481cc/volumes/kubernetes.io~projected/kube-api-access-hw2bl DeviceMajor:0 DeviceMinor:234 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8d80326ad1588cb52a3437536457829135aafa79deab8a6eedba50e03a51a17b/userdata/shm DeviceMajor:0 DeviceMinor:335 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-405 DeviceMajor:0 DeviceMinor:405 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:223 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f/volumes/kubernetes.io~projected/kube-api-access-jpjm4 DeviceMajor:0 DeviceMinor:286 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/b9c410c1-b967-4f7c-8478-ff14cd4696b3/volumes/kubernetes.io~projected/kube-api-access-cjh4n DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-116 DeviceMajor:0 DeviceMinor:116 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eb9de1fa-933d-49a5-84ed-2418c40eead3/volumes/kubernetes.io~projected/kube-api-access-6lqls DeviceMajor:0 DeviceMinor:239 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b5fef5d7-aeae-4377-b42a-18ca1db1aef4/volumes/kubernetes.io~projected/kube-api-access-9hg5t DeviceMajor:0 DeviceMinor:52 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7026bee2-54f0-43f2-aaeb-b7c81acd5e68/volumes/kubernetes.io~projected/kube-api-access-5z6nn DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/volumes/kubernetes.io~projected/kube-api-access-t8l2r DeviceMajor:0 DeviceMinor:209 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-393 DeviceMajor:0 DeviceMinor:393 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b69c6a2460fb985f25490237971cdb1e4f78953b75a9b1f7ac2c9528e8fb1d36/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/126dde09b6b61e3178615ee48df1b3faa265973355d46d408097ad8519c5495b/userdata/shm DeviceMajor:0 DeviceMinor:213 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/23e2e6b5-2a6a-4d14-ad7a-784442fd6960/volumes/kubernetes.io~projected/kube-api-access-r4q8k DeviceMajor:0 DeviceMinor:235 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9c410c1-b967-4f7c-8478-ff14cd4696b3/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:383 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a5515bc6-8312-4be8-999c-9072fa30b526/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:388 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/855d815d22495e18c1befba8c75560ae9983b8459aab715138cc70c8286b4581/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb/volumes/kubernetes.io~projected/kube-api-access-tvqhl DeviceMajor:0 DeviceMinor:214 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6f2a54f91e38ab7a6bd32cf9bd4d5451c3cf76dc353b45fd7184a957e7f4b55a/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-309 DeviceMajor:0 DeviceMinor:309 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0cc85c1ed36232ce5e9b7c84aa202701d1ebff7ad6db003a7e352af983f6c949/userdata/shm DeviceMajor:0 DeviceMinor:357 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-395 DeviceMajor:0 DeviceMinor:395 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/204ffe78-eee5-4cf4-9eb3-23a4034a26af/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:48 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/64cf3434-1c3d-4036-9a55-4eb3958b16d4/volumes/kubernetes.io~projected/kube-api-access-8bh79 DeviceMajor:0 DeviceMinor:323 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534/volumes/kubernetes.io~projected/kube-api-access-nxl2t DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/db22bba6-c4a6-4ff0-8c60-60f0c4e61864/volumes/kubernetes.io~projected/kube-api-access-mszds DeviceMajor:0 DeviceMinor:208 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1ebd0b165e2c9e9b195e597b658e48acc61a0abfa9e1036b0c521e6b08bb58c6/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/32f3f34942f80b4fc656dda1ee653c4f26ad6ca4f094bcbb9c7578a9c5fc301c/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/64cf3434-1c3d-4036-9a55-4eb3958b16d4/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:438 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7f630f6b-6df2-4c78-9aff-8f2577cfb56c/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:50 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e7b27302-be59-4dc9-8e64-0ea2b2f4baa2/volumes/kubernetes.io~projected/kube-api-access-wlqdc DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b8e7b34c90abddc1961c748b822216734a01e82bf0cf9dd3823c751416a91dd1/userdata/shm DeviceMajor:0 DeviceMinor:353 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/efeeb148cce4ca1b9ed2689a1996a7bc599bb97394aac89ce8c6d32aed3489ef/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/eb9de1fa-933d-49a5-84ed-2418c40eead3/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:219 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2523fa7a-1747-4695-a737-5c2a1caf2864/volumes/kubernetes.io~projected/kube-api-access-4rcbl DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/205b7f1f571d14a8f325e7fefc350340a8315cd3f4a6f29c86c2f70fa80cdf47/userdata/shm DeviceMajor:0 DeviceMinor:444 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2ddd9e3718a9ca803e5295740438bd22a6137393f9e2c01e094be5bed6b62856/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ed6eb69243a6015f118d16cdd86b43ba54733a08b946f7e413fa35608c608b04/userdata/shm DeviceMajor:0 DeviceMinor:218 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4719dd5a254d29d65621a9acf38fc6cece137d43ffd79ef25726ad4130359ece/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7ade972d-dd5c-4128-bdd8-98647d69d3a8/volumes/kubernetes.io~secret/networking-console-plugin-cert DeviceMajor:0 DeviceMinor:240 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/32575811-fcf4-4bcd-beb3-6bc4f0d472bd/volumes/kubernetes.io~projected/kube-api-access-wjzq2 DeviceMajor:0 DeviceMinor:206 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/833dab624c0785600333f95b5d4a9914e1bb57e7c6226232b25aea6390bb0bcd/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-293 DeviceMajor:0 DeviceMinor:293 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0dae4f31-8ea9-480a-881f-61bad1def6bc/volumes/kubernetes.io~projected/kube-api-access-h4qvr DeviceMajor:0 DeviceMinor:210 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/23e2e6b5-2a6a-4d14-ad7a-784442fd6960/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:221 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/39c99098-aa34-4200-b2a4-2404ae1cd454/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:220 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/08135341690f79cf38e4a486c8719672f762267b9f9635a765706e16f1685f0a/userdata/shm DeviceMajor:0 DeviceMinor:226 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls DeviceMajor:0 DeviceMinor:225 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a0747bf5-ca98-4d2c-9723-3c226817ee66/volumes/kubernetes.io~secret/samples-operator-tls DeviceMajor:0 DeviceMinor:236 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/b5fef5d7-aeae-4377-b42a-18ca1db1aef4/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:47 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7735f8ec-f901-4584-b995-6f5b4bb14a79/volumes/kubernetes.io~projected/kube-api-access-74l2w DeviceMajor:0 DeviceMinor:205 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a5d11da4-5f47-4bba-bc30-54df80304964/volumes/kubernetes.io~projected/kube-api-access-9f7qj DeviceMajor:0 DeviceMinor:207 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:238 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/760c893e-a6be-4c31-ad76-c1922d08a5d4/volumes/kubernetes.io~projected/kube-api-access-mjs68 DeviceMajor:0 DeviceMinor:330 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/809eb917b81584137c68e2532130a9db4b7ad49b75141b1b297cab7e92fbfdfc/userdata/shm DeviceMajor:0 DeviceMinor:391 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/204ffe78-eee5-4cf4-9eb3-23a4034a26af/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:49 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2/volumes/kubernetes.io~projected/kube-api-access-8m67j DeviceMajor:0 DeviceMinor:51 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6a16b8bcb0c04e38e3802c062bafc0373e7be3e531e33a78e3c68182d3c1c465/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b5fef5d7-aeae-4377-b42a-18ca1db1aef4/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/a0747bf5-ca98-4d2c-9723-3c226817ee66/volumes/kubernetes.io~projected/kube-api-access-vwb8w DeviceMajor:0 DeviceMinor:211 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~projected/registry-tls DeviceMajor:0 DeviceMinor:346 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0b4634955beca7a6aadb94c1583baad38a6041e9a788ef8fe348c6ef91bc8936/userdata/shm DeviceMajor:0 DeviceMinor:389 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/74bc8edbf0633a2bb226c5ad5ecd03561b6ca4f84052268ddecbac6a9b3a93f4/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/204ffe78-eee5-4cf4-9eb3-23a4034a26af/volumes/kubernetes.io~projected/kube-api-access-d57sr DeviceMajor:0 DeviceMinor:53 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9198c4bb29241f690e2e12c5f7b8555d0fedfc6399c756b2609919ffb2b600fd/userdata/shm DeviceMajor:0 DeviceMinor:229 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-399 DeviceMajor:0 DeviceMinor:399 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-407 DeviceMajor:0 DeviceMinor:407 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/88e3eca136b571a6f05b7ff58fdf07b2810178d981214344276d32cef01e0118/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/db22bba6-c4a6-4ff0-8c60-60f0c4e61864/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes/kubernetes.io~projected/kube-api-access-jf2dx DeviceMajor:0 DeviceMinor:241 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-416 DeviceMajor:0 DeviceMinor:416 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f7f31624c71b21638eb1c6b0da90d1855722588ac6e35b651c53eb994d5b7281/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-303 DeviceMajor:0 DeviceMinor:303 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8cf8f7d0377ef4fec32c5869b67a9120b502a51b0b2498b48e5ceef81576a8ed/userdata/shm DeviceMajor:0 DeviceMinor:347 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c117e5da23d812319064ebe402a785391e922e428ef375b1067c386291417f14/userdata/shm DeviceMajor:0 DeviceMinor:355 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:08135341690f79c MacAddress:b2:72:5c:7b:65:de Speed:10000 Mtu:8901} {Name:08d11690d865dc7 MacAddress:3a:bb:ad:ef:7f:d0 Speed:10000 Mtu:8901} {Name:0b4634955beca7a MacAddress:8e:61:f6:db:11:53 Speed:10000 Mtu:8901} {Name:0cc85c1ed36232c MacAddress:72:8e:e5:c1:35:b8 Speed:10000 Mtu:8901} {Name:126dde09b6b61e3 MacAddress:7e:44:12:1e:f2:19 Speed:10000 Mtu:8901} {Name:1ebd0b165e2c9e9 MacAddress:be:12:be:03:f2:65 Speed:10000 Mtu:8901} {Name:205b7f1f571d14a MacAddress:72:89:41:9c:40:9f Speed:10000 Mtu:8901} {Name:32f3f34942f80b4 MacAddress:fa:8f:34:76:c2:ac Speed:10000 Mtu:8901} {Name:408c940f390e9a3 MacAddress:0e:c1:cd:ba:54:f4 Speed:10000 Mtu:8901} {Name:4719dd5a254d29d MacAddress:52:84:f8:a4:de:29 Speed:10000 Mtu:8901} {Name:6f2a54f91e38ab7 MacAddress:32:35:1a:4e:dd:23 Speed:10000 Mtu:8901} {Name:809eb917b815841 MacAddress:ba:e8:65:5d:cc:fa Speed:10000 Mtu:8901} {Name:833dab624c07856 MacAddress:12:4e:70:e5:fa:89 Speed:10000 Mtu:8901} {Name:8cf8f7d0377ef4f MacAddress:56:a6:b3:ad:68:8e Speed:10000 Mtu:8901} {Name:8d80326ad1588cb MacAddress:2e:76:ed:b6:fc:30 Speed:10000 Mtu:8901} {Name:9198c4bb29241f6 MacAddress:52:8a:55:ab:63:60 Speed:10000 Mtu:8901} {Name:99e1f978397ad7f MacAddress:b6:01:9d:bf:57:55 Speed:10000 Mtu:8901} {Name:b8e7b34c90abddc MacAddress:86:ee:37:ac:aa:7a Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:68:50:f0:6f:71 Speed:0 Mtu:9001} {Name:br-int MacAddress:3a:32:0f:d9:1c:9e Speed:0 Mtu:8901} {Name:c117e5da23d8123 MacAddress:b6:02:fa:47:c7:a0 Speed:10000 Mtu:8901} {Name:ed6eb69243a6015 MacAddress:9a:fc:3f:64:9a:33 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:68:50:f0:6f:71 Speed:0 Mtu:9001} {Name:f7f31624c71b216 MacAddress:66:6e:4a:59:e6:fe Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:7a:bc:53:af:49:68 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:de:fd:3c:59:6b:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:23:19.074320 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074092    5575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:23:19.074320 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074134    5575 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:23:19.074476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074452    5575 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:23:19.074599 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074477    5575 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-135.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:23:19.074645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074602    5575 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:23:19.074645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074611    5575 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:23:19.074645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074623    5575 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:23:19.074645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074641    5575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:23:19.074741 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074659    5575 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:23:19.074834 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074825    5575 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:23:19.074931 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074923    5575 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:23:19.074960 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074957    5575 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:23:19.075001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.074989    5575 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:23:19.075029 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.075004    5575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:23:19.075064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.075057    5575 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:23:19.075107 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.075068    5575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:23:19.075860 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.075843    5575 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:23:19.075860 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.075857    5575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:23:19.077518 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.076371    5575 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:23:19.079606 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.079591    5575 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:23:19.079606 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.079607    5575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:23:19.079710 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.079700    5575 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 21:23:19.079884 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.079874    5575 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:23:19.079921 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.079903    5575 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:23:19.080032 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080023    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:23:19.080064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080037    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:23:19.080064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080043    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:23:19.080064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080048    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:23:19.080064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080054    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:23:19.080064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080059    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:23:19.080064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080065    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:23:19.080293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080071    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:23:19.080293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080078    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:23:19.080293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080083    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:23:19.080293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080091    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:23:19.080293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080100    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:23:19.080293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080123    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:23:19.080293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.080129    5575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:23:19.083415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.083399    5575 server.go:1263] "Started kubelet"
Oct 30 21:23:19.083885 ip-10-0-136-135 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:23:19.084727 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.083649    5575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:23:19.084727 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.083956    5575 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:23:19.084727 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.083453    5575 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:23:19.084727 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.084405    5575 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:23:19.085368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.085354    5575 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:23:19.087300 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.087284    5575 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:23:19.087382 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.087301    5575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:23:19.087382 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.087341    5575 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:23:19.087489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.087372    5575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:17:09 +0000 UTC" deadline="2028-05-19 16:54:23.817878646 +0000 UTC"
Oct 30 21:23:19.087489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.087405    5575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13603h31m4.730476408s"
Oct 30 21:23:19.087489 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:19.087423    5575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-135.us-west-1.compute.internal\" not found"
Oct 30 21:23:19.087629 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.087353    5575 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:23:19.087629 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.087585    5575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:23:19.089953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.089925    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5fef5d7-aeae-4377-b42a-18ca1db1aef4" volumeName="kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-env-overrides" seLinuxMountContext=""
Oct 30 21:23:19.090066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.089953    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dae4f31-8ea9-480a-881f-61bad1def6bc" volumeName="kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-default-certificate" seLinuxMountContext=""
Oct 30 21:23:19.090066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.089983    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="204ffe78-eee5-4cf4-9eb3-23a4034a26af" volumeName="kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-tmp" seLinuxMountContext=""
Oct 30 21:23:19.090066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.089995    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bfa550e-e2f4-4549-993f-5bbe3ebac5c2" volumeName="kubernetes.io/projected/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-kube-api-access-8m67j" seLinuxMountContext=""
Oct 30 21:23:19.090066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090006    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" volumeName="kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates" seLinuxMountContext=""
Oct 30 21:23:19.090066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090019    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" volumeName="kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets" seLinuxMountContext=""
Oct 30 21:23:19.090066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090029    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5fef5d7-aeae-4377-b42a-18ca1db1aef4" volumeName="kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-config" seLinuxMountContext=""
Oct 30 21:23:19.090066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090037    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb9de1fa-933d-49a5-84ed-2418c40eead3" volumeName="kubernetes.io/secret/eb9de1fa-933d-49a5-84ed-2418c40eead3-cert" seLinuxMountContext=""
Oct 30 21:23:19.090066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090050    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39c99098-aa34-4200-b2a4-2404ae1cd454" volumeName="kubernetes.io/configmap/39c99098-aa34-4200-b2a4-2404ae1cd454-config" seLinuxMountContext=""
Oct 30 21:23:19.090066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090062    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ade972d-dd5c-4128-bdd8-98647d69d3a8" volumeName="kubernetes.io/configmap/7ade972d-dd5c-4128-bdd8-98647d69d3a8-nginx-conf" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090073    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="822b5a15-b6cd-4106-b4c7-76ae8d6db19a" volumeName="kubernetes.io/configmap/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-iptables-alerter-script" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090086    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" volumeName="kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090097    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5816f96-8b2e-4f04-a675-500b2a4044df" volumeName="kubernetes.io/projected/a5816f96-8b2e-4f04-a675-500b2a4044df-kube-api-access-swsv4" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090105    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9c410c1-b967-4f7c-8478-ff14cd4696b3" volumeName="kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090117    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db22bba6-c4a6-4ff0-8c60-60f0c4e61864" volumeName="kubernetes.io/projected/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-kube-api-access-mszds" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090128    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387" volumeName="kubernetes.io/secret/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-serving-cert" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090140    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dae4f31-8ea9-480a-881f-61bad1def6bc" volumeName="kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-stats-auth" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090151    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bfa550e-e2f4-4549-993f-5bbe3ebac5c2" volumeName="kubernetes.io/configmap/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-serviceca" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090164    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387" volumeName="kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-config" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090175    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7b27302-be59-4dc9-8e64-0ea2b2f4baa2" volumeName="kubernetes.io/projected/e7b27302-be59-4dc9-8e64-0ea2b2f4baa2-kube-api-access-wlqdc" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090186    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dae4f31-8ea9-480a-881f-61bad1def6bc" volumeName="kubernetes.io/projected/0dae4f31-8ea9-480a-881f-61bad1def6bc-kube-api-access-h4qvr" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090197    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" volumeName="kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090208    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" volumeName="kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090219    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" volumeName="kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090232    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a0747bf5-ca98-4d2c-9723-3c226817ee66" volumeName="kubernetes.io/projected/a0747bf5-ca98-4d2c-9723-3c226817ee66-kube-api-access-vwb8w" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090243    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5fef5d7-aeae-4377-b42a-18ca1db1aef4" volumeName="kubernetes.io/secret/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090253    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb" volumeName="kubernetes.io/projected/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-kube-api-access-tvqhl" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090268    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="204ffe78-eee5-4cf4-9eb3-23a4034a26af" volumeName="kubernetes.io/projected/204ffe78-eee5-4cf4-9eb3-23a4034a26af-kube-api-access-d57sr" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090285    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2523fa7a-1747-4695-a737-5c2a1caf2864" volumeName="kubernetes.io/empty-dir/2523fa7a-1747-4695-a737-5c2a1caf2864-tmp-dir" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090294    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64cf3434-1c3d-4036-9a55-4eb3958b16d4" volumeName="kubernetes.io/empty-dir/64cf3434-1c3d-4036-9a55-4eb3958b16d4-data-volume" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090304    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" volumeName="kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090315    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" volumeName="kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090327    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f630f6b-6df2-4c78-9aff-8f2577cfb56c" volumeName="kubernetes.io/secret/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-agent-certs" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090341    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a0747bf5-ca98-4d2c-9723-3c226817ee66" volumeName="kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090349    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5515bc6-8312-4be8-999c-9072fa30b526" volumeName="kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090356    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5d11da4-5f47-4bba-bc30-54df80304964" volumeName="kubernetes.io/projected/a5d11da4-5f47-4bba-bc30-54df80304964-kube-api-access-9f7qj" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090364    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9c410c1-b967-4f7c-8478-ff14cd4696b3" volumeName="kubernetes.io/projected/b9c410c1-b967-4f7c-8478-ff14cd4696b3-kube-api-access-cjh4n" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090370    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df296dbb-fcbc-44be-ac0d-9dc2c84481cc" volumeName="kubernetes.io/configmap/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-config-volume" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090377    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df296dbb-fcbc-44be-ac0d-9dc2c84481cc" volumeName="kubernetes.io/empty-dir/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-tmp-dir" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090384    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387" volumeName="kubernetes.io/projected/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-kube-api-access-t8l2r" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090391    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dae4f31-8ea9-480a-881f-61bad1def6bc" volumeName="kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090398    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23e2e6b5-2a6a-4d14-ad7a-784442fd6960" volumeName="kubernetes.io/configmap/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-config" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090410    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39c99098-aa34-4200-b2a4-2404ae1cd454" volumeName="kubernetes.io/secret/39c99098-aa34-4200-b2a4-2404ae1cd454-serving-cert" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090422    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="204ffe78-eee5-4cf4-9eb3-23a4034a26af" volumeName="kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-tuned" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090434    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23e2e6b5-2a6a-4d14-ad7a-784442fd6960" volumeName="kubernetes.io/projected/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-kube-api-access-r4q8k" seLinuxMountContext=""
Oct 30 21:23:19.090423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090445    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f630f6b-6df2-4c78-9aff-8f2577cfb56c" volumeName="kubernetes.io/configmap/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-konnectivity-ca" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090453    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="822b5a15-b6cd-4106-b4c7-76ae8d6db19a" volumeName="kubernetes.io/projected/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-kube-api-access-4gwjc" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090463    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db22bba6-c4a6-4ff0-8c60-60f0c4e61864" volumeName="kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-tmp" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090474    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df296dbb-fcbc-44be-ac0d-9dc2c84481cc" volumeName="kubernetes.io/projected/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-kube-api-access-hw2bl" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090487    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1737ddb3-e512-4944-8aad-94fac75a3a7e" volumeName="kubernetes.io/projected/1737ddb3-e512-4944-8aad-94fac75a3a7e-kube-api-access-d4cxm" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090497    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e60dadc-7b2d-47e1-930e-fbfb5a1c9534" volumeName="kubernetes.io/projected/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kube-api-access-nxl2t" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090505    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64cf3434-1c3d-4036-9a55-4eb3958b16d4" volumeName="kubernetes.io/projected/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-api-access-8bh79" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090513    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db22bba6-c4a6-4ff0-8c60-60f0c4e61864" volumeName="kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090524    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df296dbb-fcbc-44be-ac0d-9dc2c84481cc" volumeName="kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090537    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387" volumeName="kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-trusted-ca" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090545    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb" volumeName="kubernetes.io/configmap/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-telemetry-config" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090557    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5816f96-8b2e-4f04-a675-500b2a4044df" volumeName="kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090564    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb9de1fa-933d-49a5-84ed-2418c40eead3" volumeName="kubernetes.io/projected/eb9de1fa-933d-49a5-84ed-2418c40eead3-kube-api-access-6lqls" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090571    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" volumeName="kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090578    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" volumeName="kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.090589    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" volumeName="kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091010    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23e2e6b5-2a6a-4d14-ad7a-784442fd6960" volumeName="kubernetes.io/secret/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-serving-cert" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091024    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2523fa7a-1747-4695-a737-5c2a1caf2864" volumeName="kubernetes.io/projected/2523fa7a-1747-4695-a737-5c2a1caf2864-kube-api-access-4rcbl" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091032    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32575811-fcf4-4bcd-beb3-6bc4f0d472bd" volumeName="kubernetes.io/projected/32575811-fcf4-4bcd-beb3-6bc4f0d472bd-kube-api-access-wjzq2" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091039    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7735f8ec-f901-4584-b995-6f5b4bb14a79" volumeName="kubernetes.io/projected/7735f8ec-f901-4584-b995-6f5b4bb14a79-kube-api-access-74l2w" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091048    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5816f96-8b2e-4f04-a675-500b2a4044df" volumeName="kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-daemon-config" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091055    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39c99098-aa34-4200-b2a4-2404ae1cd454" volumeName="kubernetes.io/projected/39c99098-aa34-4200-b2a4-2404ae1cd454-kube-api-access-gsvhv" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091064    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5fef5d7-aeae-4377-b42a-18ca1db1aef4" volumeName="kubernetes.io/projected/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-kube-api-access-9hg5t" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091075    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb" volumeName="kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091084    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f" volumeName="kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091091    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a0747bf5-ca98-4d2c-9723-3c226817ee66" volumeName="kubernetes.io/configmap/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-config" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091099    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5fef5d7-aeae-4377-b42a-18ca1db1aef4" volumeName="kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091107    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dae4f31-8ea9-480a-881f-61bad1def6bc" volumeName="kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091114    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" volumeName="kubernetes.io/projected/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-kube-api-access-5z6nn" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091120    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="760c893e-a6be-4c31-ad76-c1922d08a5d4" volumeName="kubernetes.io/projected/760c893e-a6be-4c31-ad76-c1922d08a5d4-kube-api-access-mjs68" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091127    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ade972d-dd5c-4128-bdd8-98647d69d3a8" volumeName="kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091134    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db22bba6-c4a6-4ff0-8c60-60f0c4e61864" volumeName="kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-service-ca-bundle" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091142    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db22bba6-c4a6-4ff0-8c60-60f0c4e61864" volumeName="kubernetes.io/secret/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-serving-cert" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091148    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64cf3434-1c3d-4036-9a55-4eb3958b16d4" volumeName="kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091155    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64cf3434-1c3d-4036-9a55-4eb3958b16d4" volumeName="kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091164    5575 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db22bba6-c4a6-4ff0-8c60-60f0c4e61864" volumeName="kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-snapshots" seLinuxMountContext=""
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091176    5575 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:23:19.091594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.091181    5575 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:23:19.096552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.096527    5575 factory.go:153] Registering CRI-O factory
Oct 30 21:23:19.096637 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.096566    5575 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:23:19.096685 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.096644    5575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:23:19.096685 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.096655    5575 factory.go:55] Registering systemd factory
Oct 30 21:23:19.096685 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.096667    5575 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:23:19.096780 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.096688    5575 factory.go:103] Registering Raw factory
Oct 30 21:23:19.096780 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.096705    5575 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:23:19.097071 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.097059    5575 manager.go:319] Starting recovery of all containers
Oct 30 21:23:19.108595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.108564    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:23:19.109985 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.109945    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:23:19.116476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.116446    5575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:23:19.118417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.118395    5575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:23:19.118417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.118418    5575 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:23:19.118719 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.118439    5575 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:23:19.118719 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:19.118479    5575 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 21:23:19.125262 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.125240    5575 generic.go:356] "Generic (PLEG): container finished" podID="24abb3b3ef955062440aec6d22d39298" containerID="e26a0eb1d1e239ae891effdce39951ce909cc652f8c5b2d100cd1ed00db333c8" exitCode=0
Oct 30 21:23:19.168544 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.168502    5575 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="48207779bcc7cf54bc1e5f46a9a3dd6ba77a55caf215bb75829e9d8c049ebf57" exitCode=0
Oct 30 21:23:19.168544 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.168533    5575 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="80fdf3b91b30787c45cc4a099296ea9b9fdbf3d3769547db1b30a8f63c3aada5" exitCode=0
Oct 30 21:23:19.168544 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.168542    5575 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="bf6edd35c4cd57a9068fd6a6494d0c4f368c3178f7cf310a22f93960c59b652a" exitCode=0
Oct 30 21:23:19.168544 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.168548    5575 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="9d6b86789ac694bd57b499f52e86ae02c50696b52d7f78370787d16b68dc4399" exitCode=0
Oct 30 21:23:19.168801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.168566    5575 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="45cac35b323e28387430c5d868d938ba7e8f770f5756226e4b6fe06d38c9a1fa" exitCode=0
Oct 30 21:23:19.168801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.168576    5575 generic.go:356] "Generic (PLEG): container finished" podID="7026bee2-54f0-43f2-aaeb-b7c81acd5e68" containerID="f7164d5740674a5a51965d4f92d1f043698f1d46775877b50469fdfe193b9b83" exitCode=0
Oct 30 21:23:19.170084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.170067    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:23:19.170195 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.170090    5575 generic.go:356] "Generic (PLEG): container finished" podID="e4efa2f2-5d48-40f5-bfc2-d4f858a4c387" containerID="8a19b13d667539386e0bf276e5822ee76936e8869fd3e3df8220508c53ab4513" exitCode=255
Oct 30 21:23:19.187511 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:19.187486    5575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-135.us-west-1.compute.internal\" not found"
Oct 30 21:23:19.202110 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.202094    5575 manager.go:324] Recovery completed
Oct 30 21:23:19.218541 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:19.218519    5575 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 21:23:19.220573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.220552    5575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:23:19.222347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.222331    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:23:19.222419 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.222359    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:23:19.222419 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.222370    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:23:19.225852 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.225831    5575 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:23:19.225852 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.225851    5575 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:23:19.226015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.225876    5575 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:23:19.226088 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226069    5575 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 21:23:19.226140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226090    5575 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 21:23:19.226140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226115    5575 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 21:23:19.226140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226123    5575 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 21:23:19.226140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226131    5575 policy_none.go:50] "Start"
Oct 30 21:23:19.226281 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226150    5575 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:23:19.226281 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226164    5575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:23:19.226281 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226191    5575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:23:19.226402 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226394    5575 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 21:23:19.226442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226404    5575 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 21:23:19.226442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.226414    5575 policy_none.go:44] "Start"
Oct 30 21:23:19.227337 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.227316    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:23:19.227402 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.227353    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:23:19.227402 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.227368    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:23:19.231452 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.231430    5575 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:23:19.233959 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.233947    5575 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:23:19.234019 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:19.233988    5575 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:23:19.234019 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.234001    5575 server.go:87] "Starting device plugin registration server"
Oct 30 21:23:19.234295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.234282    5575 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:23:19.234326 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.234301    5575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:23:19.234426 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.234407    5575 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:23:19.234546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.234509    5575 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:23:19.234656 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.234559    5575 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:23:19.234656 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.234567    5575 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:23:19.234751 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.234626    5575 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:23:19.234545108Z","UUID":"bd2b9272-5771-461c-984a-9b6fbedcab19","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:23:19.235951 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.235926    5575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:23:19.236060 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.235990    5575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:23:19.236113 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:19.236086    5575 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:23:19.236151 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:19.236121    5575 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-135.us-west-1.compute.internal\" not found"
Oct 30 21:23:19.242775 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.242758    5575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:23:19.258031 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:19.258008    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64cf3434_1c3d_4036_9a55_4eb3958b16d4.slice/crio-205b7f1f571d14a8f325e7fefc350340a8315cd3f4a6f29c86c2f70fa80cdf47 WatchSource:0}: Error finding container 205b7f1f571d14a8f325e7fefc350340a8315cd3f4a6f29c86c2f70fa80cdf47: Status 404 returned error can't find the container with id 205b7f1f571d14a8f325e7fefc350340a8315cd3f4a6f29c86c2f70fa80cdf47
Oct 30 21:23:19.292739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.292717    5575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:23:19.292830 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.292816    5575 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 21:23:19.294274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.294258    5575 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:23:19.335308 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.335261    5575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:23:19.336135 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.336119    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:23:19.336209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.336151    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:23:19.336209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.336165    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:23:19.336272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.336212    5575 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.389383 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.389366    5575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:23:19.418706 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.418662    5575 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"]
Oct 30 21:23:19.419256 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.419228    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal" event={"ID":"24abb3b3ef955062440aec6d22d39298","Type":"ContainerDied","Data":"e26a0eb1d1e239ae891effdce39951ce909cc652f8c5b2d100cd1ed00db333c8"}
Oct 30 21:23:19.419310 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.419269    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal" event={"ID":"24abb3b3ef955062440aec6d22d39298","Type":"ContainerStarted","Data":"2ddd9e3718a9ca803e5295740438bd22a6137393f9e2c01e094be5bed6b62856"}
Oct 30 21:23:19.419348 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.419311    5575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.419348 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.419325    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal" event={"ID":"318fdbac2e696c24464ab55f83e20597","Type":"ContainerStarted","Data":"85ba9ff0348d190e87ede0b8ed207de26a0d9d8b5d67aecb1652c655ed1fb764"}
Oct 30 21:23:19.419348 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.419341    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal" event={"ID":"318fdbac2e696c24464ab55f83e20597","Type":"ContainerStarted","Data":"6a16b8bcb0c04e38e3802c062bafc0373e7be3e531e33a78e3c68182d3c1c465"}
Oct 30 21:23:19.419567 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.419556    5575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.445706 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.445686    5575 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.445779 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.445735    5575 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.446185 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.446172    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeNotReady"
Oct 30 21:23:19.446229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.446199    5575 setters.go:546] "Node became not ready" node="ip-10-0-136-135.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-10-30T21:23:19Z","lastTransitionTime":"2026-10-30T21:23:19Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Oct 30 21:23:19.483806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.483788    5575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:23:19.483865 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:19.483825    5575 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.485076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.485063    5575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:23:19.485119 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:19.485092    5575 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.494367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.494347    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.494421 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.494373    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.494421 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.494389    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/318fdbac2e696c24464ab55f83e20597-config\") pod \"kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"318fdbac2e696c24464ab55f83e20597\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.503895 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.503878    5575 nodeinfomanager.go:471] existing CSINode "ip-10-0-136-135.us-west-1.compute.internal" is owned by different node (oldNodeID="0a79f0f2-716b-419f-96ff-6310be5f8751", newNodeID=""), cleaning up...
Oct 30 21:23:19.594872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.594822    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/318fdbac2e696c24464ab55f83e20597-config\") pod \"kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"318fdbac2e696c24464ab55f83e20597\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.594872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.594868    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.594995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.594884    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.594995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.594927    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.594995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.594940    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/318fdbac2e696c24464ab55f83e20597-config\") pod \"kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"318fdbac2e696c24464ab55f83e20597\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:19.594995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:19.594940    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24abb3b3ef955062440aec6d22d39298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" (UID: \"24abb3b3ef955062440aec6d22d39298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:20.076117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.076092    5575 apiserver.go:52] "Watching apiserver"
Oct 30 21:23:20.184452 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.184430    5575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:20.230076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.230054    5575 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:23:20.230704 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.230682    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-k4gdh","kube-system/kas-connection-checker-685895c7c9-7xpgb","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m","openshift-ovn-kubernetes/ovnkube-node-lsvj4","openshift-multus/multus-4p5ng","openshift-network-diagnostics/network-check-target-qm2pw","openshift-dns/dns-default-7fr7k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn","openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8","openshift-kube-storage-version-migrator/migrator-66df5d496b-749th","kube-system/global-pull-secret-syncer-s4z6n","openshift-dns/node-resolver-cgnp7","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x","kube-system/kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal","openshift-insights/insights-runtime-extractor-jbkhl","openshift-ingress-canary/ingress-canary-g8nnl","kube-system/kas-connection-checker-685895c7c9-h6pc5","openshift-multus/network-metrics-daemon-vps4x","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg","openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg","kube-system/kas-connection-checker-685895c7c9-s5j2v","openshift-image-registry/image-registry-7659844d84-4hwr6","openshift-cluster-node-tuning-operator/tuned-2gbd4","openshift-multus/multus-additional-cni-plugins-k4wl2","openshift-console-operator/console-operator-7cd56b8dbc-8hk9c","openshift-insights/insights-operator-7c4986d449-2thg2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal","openshift-network-diagnostics/network-check-source-6f78d59f99-948s6","openshift-network-console/networking-console-plugin-86c478bb88-xc5td","kube-system/konnectivity-agent-5szpn","openshift-ingress/router-default-66bc45fc97-b8kwb","openshift-network-operator/iptables-alerter-25zhv"]
Oct 30 21:23:20.245568 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.245544    5575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:23:20.246645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.246610    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.279450 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:20.279426    5575 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-135.us-west-1.compute.internal"
Oct 30 21:23:20.284690 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.284670    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.284823 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.284803    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.284886 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.284808    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 21:23:20.284886 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.284864    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 21:23:20.285394 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.285112    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.285951 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.285923    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.286269 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.286252    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 21:23:20.286353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.286278    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.286353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.286330    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.286506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.286487    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 21:23:20.286687 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.286532    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.286687 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.286560    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 21:23:20.286687 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.286564    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.287090 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.287045    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 21:23:20.289096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.288423    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 21:23:20.289096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.288674    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.289096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.288758    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 21:23:20.289842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.289439    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:23:20.289842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.289481    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 21:23:20.289842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.289549    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.291115 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.291095    5575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:23:20.298960 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.298938    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-host\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:23:20.299043 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.298982    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovn-node-metrics-cert\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.299043 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299004    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.299043 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299019    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ade972d-dd5c-4128-bdd8-98647d69d3a8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:23:20.299187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299082    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-socket-dir-parent\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.299187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299113    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-netns\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.299187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299174    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-tmp\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.299272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299191    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-bin\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.299272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299206    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-script-lib\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.299272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299220    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.299272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299258    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:23:20.299404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299293    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-registration-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.299404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299262    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-tmp\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.299404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299320    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-system-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.299404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299351    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-kubelet\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.299404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299384    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gwjc\" (UniqueName: \"kubernetes.io/projected/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-kube-api-access-4gwjc\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:23:20.299595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299444    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjs68\" (UniqueName: \"kubernetes.io/projected/760c893e-a6be-4c31-ad76-c1922d08a5d4-kube-api-access-mjs68\") pod \"migrator-66df5d496b-749th\" (UID: \"760c893e-a6be-4c31-ad76-c1922d08a5d4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"
Oct 30 21:23:20.299595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299529    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64cf3434-1c3d-4036-9a55-4eb3958b16d4-data-volume\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.299595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299571    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-stats-auth\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.299710 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299600    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-ovn\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.299710 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299649    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64cf3434-1c3d-4036-9a55-4eb3958b16d4-data-volume\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.299710 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299701    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.299807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299736    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.299807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299752    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-lib-modules\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.299807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299779    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-default-certificate\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.299807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299798    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:23:20.300039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299818    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-tmp-dir\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:20.300039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299831    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-stats-auth\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.300039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299880    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-config\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:23:20.300039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299903    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-daemon-config\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.300039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.299981    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-tmp-dir\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:20.300039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300014    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39c99098-aa34-4200-b2a4-2404ae1cd454-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:23:20.300254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300046    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.300254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300069    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2523fa7a-1747-4695-a737-5c2a1caf2864-tmp-dir\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:23:20.300254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300081    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-default-certificate\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.300254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300094    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-etc-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.300254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300177    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2523fa7a-1747-4695-a737-5c2a1caf2864-tmp-dir\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:23:20.300254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300201    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.300254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300223    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39c99098-aa34-4200-b2a4-2404ae1cd454-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:23:20.300254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300227    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsvhv\" (UniqueName: \"kubernetes.io/projected/39c99098-aa34-4200-b2a4-2404ae1cd454-kube-api-access-gsvhv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:23:20.300475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300269    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-systemd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.300475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300287    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-netd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.300475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300316    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-dbus\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:20.300475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300334    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-sys-fs\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.300475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300351    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-cni-binary-copy\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.300475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300395    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-multus\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.300475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300403    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dae4f31-8ea9-480a-881f-61bad1def6bc-metrics-certs\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.300475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300429    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-var-lib-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.300475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300456    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf2dx\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.300720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300555    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-config-volume\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:20.300720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300587    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-kubelet\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.300720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300634    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-binary-copy\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.300720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300664    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64cf3434-1c3d-4036-9a55-4eb3958b16d4-crio-socket\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.300720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300702    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.300894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300722    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:23:20.300894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300739    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-cnibin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.300894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300755    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.300894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300776    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-systemd-units\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.300894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300831    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:23:20.300894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300884    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z6nn\" (UniqueName: \"kubernetes.io/projected/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-kube-api-access-5z6nn\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.301165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300909    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dae4f31-8ea9-480a-881f-61bad1def6bc-service-ca-bundle\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.301165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.300958    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-var-lib-kubelet\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.301165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301048    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:23:20.301165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301080    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwb8w\" (UniqueName: \"kubernetes.io/projected/a0747bf5-ca98-4d2c-9723-3c226817ee66-kube-api-access-vwb8w\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:23:20.301165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301096    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxl2t\" (UniqueName: \"kubernetes.io/projected/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kube-api-access-nxl2t\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.301165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301112    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2523fa7a-1747-4695-a737-5c2a1caf2864-hosts-file\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:23:20.301165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301127    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjh4n\" (UniqueName: \"kubernetes.io/projected/b9c410c1-b967-4f7c-8478-ff14cd4696b3-kube-api-access-cjh4n\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:23:20.301165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301143    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-config\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301199    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39c99098-aa34-4200-b2a4-2404ae1cd454-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301274    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301297    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-env-overrides\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301321    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swsv4\" (UniqueName: \"kubernetes.io/projected/a5816f96-8b2e-4f04-a675-500b2a4044df-kube-api-access-swsv4\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301340    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301356    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4cxm\" (UniqueName: \"kubernetes.io/projected/1737ddb3-e512-4944-8aad-94fac75a3a7e-kube-api-access-d4cxm\") pod \"network-check-source-6f78d59f99-948s6\" (UID: \"1737ddb3-e512-4944-8aad-94fac75a3a7e\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301370    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301386    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-tuned\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301403    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74l2w\" (UniqueName: \"kubernetes.io/projected/7735f8ec-f901-4584-b995-6f5b4bb14a79-kube-api-access-74l2w\") pod \"kas-connection-checker-685895c7c9-7xpgb\" (UID: \"7735f8ec-f901-4584-b995-6f5b4bb14a79\") " pod="kube-system/kas-connection-checker-685895c7c9-7xpgb"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301426    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-config\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301452    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7qj\" (UniqueName: \"kubernetes.io/projected/a5d11da4-5f47-4bba-bc30-54df80304964-kube-api-access-9f7qj\") pod \"volume-data-source-validator-58c9f5f46d-dz9pg\" (UID: \"a5d11da4-5f47-4bba-bc30-54df80304964\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301470    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-tuned\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301483    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-k8s-cni-cncf-io\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301509    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m67j\" (UniqueName: \"kubernetes.io/projected/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-kube-api-access-8m67j\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:23:20.301583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301561    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9de1fa-933d-49a5-84ed-2418c40eead3-cert\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301608    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39c99098-aa34-4200-b2a4-2404ae1cd454-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301620    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-iptables-alerter-script\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301660    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-serving-cert\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301691    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8l2r\" (UniqueName: \"kubernetes.io/projected/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-kube-api-access-t8l2r\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301717    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-konnectivity-ca\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301743    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-device-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301772    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301812    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4q8k\" (UniqueName: \"kubernetes.io/projected/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-kube-api-access-r4q8k\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301867    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-host\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301896    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d57sr\" (UniqueName: \"kubernetes.io/projected/204ffe78-eee5-4cf4-9eb3-23a4034a26af-kube-api-access-d57sr\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301913    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301929    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-agent-certs\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301950    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-serving-cert\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.301994    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302017    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302032    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-hostroot\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302078    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302095    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqls\" (UniqueName: \"kubernetes.io/projected/eb9de1fa-933d-49a5-84ed-2418c40eead3-kube-api-access-6lqls\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302109    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-sys\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302129    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-socket-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302180    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-serviceca\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302198    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bh79\" (UniqueName: \"kubernetes.io/projected/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-api-access-8bh79\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302207    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:23:20.302215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302215    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-service-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302249    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-log-socket\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302267    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hg5t\" (UniqueName: \"kubernetes.io/projected/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-kube-api-access-9hg5t\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302299    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-kubelet-config\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302318    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvqhl\" (UniqueName: \"kubernetes.io/projected/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-kube-api-access-tvqhl\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302335    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-modprobe-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302355    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-kubernetes\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302409    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302442    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-system-cni-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302473    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-serving-cert\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302511    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw2bl\" (UniqueName: \"kubernetes.io/projected/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-kube-api-access-hw2bl\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302552    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-serving-cert\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302594    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mszds\" (UniqueName: \"kubernetes.io/projected/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-kube-api-access-mszds\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302667    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-slash\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302698    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302723    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cnibin\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302738    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-etc-selinux\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302794    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-etc-kubernetes\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302795    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302825    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-node-log\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302874    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjzq2\" (UniqueName: \"kubernetes.io/projected/32575811-fcf4-4bcd-beb3-6bc4f0d472bd-kube-api-access-wjzq2\") pod \"kas-connection-checker-685895c7c9-s5j2v\" (UID: \"32575811-fcf4-4bcd-beb3-6bc4f0d472bd\") " pod="kube-system/kas-connection-checker-685895c7c9-s5j2v"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302895    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302902    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-service-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302912    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-conf\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302944    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-systemd\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.302980    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303000    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303059    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-conf-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303074    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-netns\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303090    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303115    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303131    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-run\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303176    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4qvr\" (UniqueName: \"kubernetes.io/projected/0dae4f31-8ea9-480a-881f-61bad1def6bc-kube-api-access-h4qvr\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.303201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303209    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-snapshots\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303237    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303265    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303292    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-bin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303319    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rcbl\" (UniqueName: \"kubernetes.io/projected/2523fa7a-1747-4695-a737-5c2a1caf2864-kube-api-access-4rcbl\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303344    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303371    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303388    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-snapshots\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303397    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-host-slash\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303427    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysconfig\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303452    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-tmp\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303478    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-multus-certs\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303528    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqdc\" (UniqueName: \"kubernetes.io/projected/e7b27302-be59-4dc9-8e64-0ea2b2f4baa2-kube-api-access-wlqdc\") pod \"kas-connection-checker-685895c7c9-h6pc5\" (UID: \"e7b27302-be59-4dc9-8e64-0ea2b2f4baa2\") " pod="kube-system/kas-connection-checker-685895c7c9-h6pc5"
Oct 30 21:23:20.304362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.303687    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204ffe78-eee5-4cf4-9eb3-23a4034a26af-tmp\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.334603 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.334556    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.335013 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.334995    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gkfxf\""
Oct 30 21:23:20.335064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.334998    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 21:23:20.335064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.335033    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 21:23:20.335199 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.335186    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 21:23:20.335452 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.335439    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-5nb2r\""
Oct 30 21:23:20.335511 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.335442    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 21:23:20.336102 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336081    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.336201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336104    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.336201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336135    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 21:23:20.336201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336186    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 21:23:20.336349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336211    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 21:23:20.336349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336143    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:23:20.336349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336228    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.336349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336244    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.336349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336265    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.336349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336273    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.336349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336283    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.336555 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336354    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 21:23:20.336555 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336364    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.336555 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336402    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.336870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336801    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.336870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336838    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-jj5qw\""
Oct 30 21:23:20.336999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336870    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 21:23:20.336999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336871    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v6bcb\""
Oct 30 21:23:20.336999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336882    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.336999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.336909    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:23:20.337157 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.337141    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gmgqb\""
Oct 30 21:23:20.337221 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.337188    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:23:20.338181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.338170    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-vm9q9\""
Oct 30 21:23:20.338364 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.338354    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:23:20.338448 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.338435    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.338800 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.338790    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:23:20.338844 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.338835    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:23:20.339020 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.339006    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rf4nn\""
Oct 30 21:23:20.339083 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.339040    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:23:20.339546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.339516    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ade972d-dd5c-4128-bdd8-98647d69d3a8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:23:20.339546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.339541    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-script-lib\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.339635 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.339529    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ade972d-dd5c-4128-bdd8-98647d69d3a8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xc5td\" (UID: \"7ade972d-dd5c-4128-bdd8-98647d69d3a8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xc5td"
Oct 30 21:23:20.339635 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.339582    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovn-node-metrics-cert\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.339804 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.339781    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 21:23:20.339913 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.339811    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:23:20.340797 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.340781    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:23:20.340987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.340793    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-cni-binary-copy\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.340987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.340804    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-config\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:23:20.340987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.340881    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-binary-copy\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.341258 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341041    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:23:20.341258 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341069    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.341258 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341101    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mbjr2\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341357    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-wjtfq\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341366    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5nrzq\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341367    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341388    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341381    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5wvjr\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341389    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341412    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-7rrvk\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341437    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nr2gm\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341461    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341486    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341493    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 21:23:20.341526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341532    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-ovnkube-config\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341543    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xqzlq\""
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341535    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lclr\""
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341565    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjpnc\""
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341630    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-ntkmx\""
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341652    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-config\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341686    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341755    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pdhmp\""
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341826    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-iptables-alerter-script\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341837    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9de1fa-933d-49a5-84ed-2418c40eead3-cert\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:23:20.341905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.341854    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-serving-cert\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:20.342210 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.342198    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-agent-certs\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:23:20.342378 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.342363    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c410c1-b967-4f7c-8478-ff14cd4696b3-metrics-certs\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:23:20.342425 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.342366    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a0747bf5-ca98-4d2c-9723-3c226817ee66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:23:20.342490 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.342475    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64cf3434-1c3d-4036-9a55-4eb3958b16d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.343688 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.343672    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.343747 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.343712    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-serving-cert\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:23:20.343747 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.343720    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-metrics-tls\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:20.343823 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.343782    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:20.343926 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.343913    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5515bc6-8312-4be8-999c-9072fa30b526-original-pull-secret\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:20.349975 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.349948    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.351084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.351070    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.355470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.355443    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.355560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.355474    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.355560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.355490    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.356234 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356217    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:23:20.356341 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356322    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:23:20.356341 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356331    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:23:20.356461 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356357    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.356461 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356374    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.356461 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356374    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.356461 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356374    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.356461 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356422    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:23:20.356461 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356431    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.356461 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356425    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.356828 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356813    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:23:20.356919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356840    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.356919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356846    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:23:20.356919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356855    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:23:20.356919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356864    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.356919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356859    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.356919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356866    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:23:20.356919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356901    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:23:20.356919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.356913    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:23:20.359829 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.359812    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.360935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.360918    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-config-volume\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:20.361041 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.361027    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-daemon-config\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.362144 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.362128    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.362205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.362141    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-env-overrides\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.362205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.362173    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f630f6b-6df2-4c78-9aff-8f2577cfb56c-konnectivity-ca\") pod \"konnectivity-agent-5szpn\" (UID: \"7f630f6b-6df2-4c78-9aff-8f2577cfb56c\") " pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:23:20.362322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.362309    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.363231 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.363219    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.363510 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.363494    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-serviceca\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.385689    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.385746    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsvhv\" (UniqueName: \"kubernetes.io/projected/39c99098-aa34-4200-b2a4-2404ae1cd454-kube-api-access-gsvhv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m\" (UID: \"39c99098-aa34-4200-b2a4-2404ae1cd454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.385763    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gwjc\" (UniqueName: \"kubernetes.io/projected/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-kube-api-access-4gwjc\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.385902    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4q8k\" (UniqueName: \"kubernetes.io/projected/23e2e6b5-2a6a-4d14-ad7a-784442fd6960-kube-api-access-r4q8k\") pod \"service-ca-operator-544d749c8c-v5fxg\" (UID: \"23e2e6b5-2a6a-4d14-ad7a-784442fd6960\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386013    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z6nn\" (UniqueName: \"kubernetes.io/projected/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-kube-api-access-5z6nn\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386142    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f7qj\" (UniqueName: \"kubernetes.io/projected/a5d11da4-5f47-4bba-bc30-54df80304964-kube-api-access-9f7qj\") pod \"volume-data-source-validator-58c9f5f46d-dz9pg\" (UID: \"a5d11da4-5f47-4bba-bc30-54df80304964\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dz9pg"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386255    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bh79\" (UniqueName: \"kubernetes.io/projected/64cf3434-1c3d-4036-9a55-4eb3958b16d4-kube-api-access-8bh79\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386302    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw2bl\" (UniqueName: \"kubernetes.io/projected/df296dbb-fcbc-44be-ac0d-9dc2c84481cc-kube-api-access-hw2bl\") pod \"dns-default-7fr7k\" (UID: \"df296dbb-fcbc-44be-ac0d-9dc2c84481cc\") " pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386322    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjzq2\" (UniqueName: \"kubernetes.io/projected/32575811-fcf4-4bcd-beb3-6bc4f0d472bd-kube-api-access-wjzq2\") pod \"kas-connection-checker-685895c7c9-s5j2v\" (UID: \"32575811-fcf4-4bcd-beb3-6bc4f0d472bd\") " pod="kube-system/kas-connection-checker-685895c7c9-s5j2v"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386334    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4cxm\" (UniqueName: \"kubernetes.io/projected/1737ddb3-e512-4944-8aad-94fac75a3a7e-kube-api-access-d4cxm\") pod \"network-check-source-6f78d59f99-948s6\" (UID: \"1737ddb3-e512-4944-8aad-94fac75a3a7e\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-948s6"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386354    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hg5t\" (UniqueName: \"kubernetes.io/projected/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-kube-api-access-9hg5t\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386379    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxl2t\" (UniqueName: \"kubernetes.io/projected/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kube-api-access-nxl2t\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386650    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjs68\" (UniqueName: \"kubernetes.io/projected/760c893e-a6be-4c31-ad76-c1922d08a5d4-kube-api-access-mjs68\") pod \"migrator-66df5d496b-749th\" (UID: \"760c893e-a6be-4c31-ad76-c1922d08a5d4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-749th"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386751    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386772    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpjm4\" (UniqueName: \"kubernetes.io/projected/0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f-kube-api-access-jpjm4\") pod \"network-check-target-qm2pw\" (UID: \"0604fbf5-9b44-4c5e-b17a-f7ddc98ad68f\") " pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386792    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlqdc\" (UniqueName: \"kubernetes.io/projected/e7b27302-be59-4dc9-8e64-0ea2b2f4baa2-kube-api-access-wlqdc\") pod \"kas-connection-checker-685895c7c9-h6pc5\" (UID: \"e7b27302-be59-4dc9-8e64-0ea2b2f4baa2\") " pod="kube-system/kas-connection-checker-685895c7c9-h6pc5"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.386956    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mszds\" (UniqueName: \"kubernetes.io/projected/db22bba6-c4a6-4ff0-8c60-60f0c4e61864-kube-api-access-mszds\") pod \"insights-operator-7c4986d449-2thg2\" (UID: \"db22bba6-c4a6-4ff0-8c60-60f0c4e61864\") " pod="openshift-insights/insights-operator-7c4986d449-2thg2"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.387086    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqls\" (UniqueName: \"kubernetes.io/projected/eb9de1fa-933d-49a5-84ed-2418c40eead3-kube-api-access-6lqls\") pod \"ingress-canary-g8nnl\" (UID: \"eb9de1fa-933d-49a5-84ed-2418c40eead3\") " pod="openshift-ingress-canary/ingress-canary-g8nnl"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.387087    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4qvr\" (UniqueName: \"kubernetes.io/projected/0dae4f31-8ea9-480a-881f-61bad1def6bc-kube-api-access-h4qvr\") pod \"router-default-66bc45fc97-b8kwb\" (UID: \"0dae4f31-8ea9-480a-881f-61bad1def6bc\") " pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.387148    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swsv4\" (UniqueName: \"kubernetes.io/projected/a5816f96-8b2e-4f04-a675-500b2a4044df-kube-api-access-swsv4\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.387193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.387149    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwb8w\" (UniqueName: \"kubernetes.io/projected/a0747bf5-ca98-4d2c-9723-3c226817ee66-kube-api-access-vwb8w\") pod \"cluster-samples-operator-6ddb6c8b94-57r7x\" (UID: \"a0747bf5-ca98-4d2c-9723-3c226817ee66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-57r7x"
Oct 30 21:23:20.388190 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.387540    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d57sr\" (UniqueName: \"kubernetes.io/projected/204ffe78-eee5-4cf4-9eb3-23a4034a26af-kube-api-access-d57sr\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.388190 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.387539    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74l2w\" (UniqueName: \"kubernetes.io/projected/7735f8ec-f901-4584-b995-6f5b4bb14a79-kube-api-access-74l2w\") pod \"kas-connection-checker-685895c7c9-7xpgb\" (UID: \"7735f8ec-f901-4584-b995-6f5b4bb14a79\") " pod="kube-system/kas-connection-checker-685895c7c9-7xpgb"
Oct 30 21:23:20.388190 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.387812    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf2dx\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.388190 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.387815    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rcbl\" (UniqueName: \"kubernetes.io/projected/2523fa7a-1747-4695-a737-5c2a1caf2864-kube-api-access-4rcbl\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:23:20.388190 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.387958    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjh4n\" (UniqueName: \"kubernetes.io/projected/b9c410c1-b967-4f7c-8478-ff14cd4696b3-kube-api-access-cjh4n\") pod \"network-metrics-daemon-vps4x\" (UID: \"b9c410c1-b967-4f7c-8478-ff14cd4696b3\") " pod="openshift-multus/network-metrics-daemon-vps4x"
Oct 30 21:23:20.388440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.388206    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvqhl\" (UniqueName: \"kubernetes.io/projected/f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb-kube-api-access-tvqhl\") pod \"cluster-monitoring-operator-884576c57-fwxj8\" (UID: \"f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fwxj8"
Oct 30 21:23:20.391664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.391644    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m67j\" (UniqueName: \"kubernetes.io/projected/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-kube-api-access-8m67j\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:23:20.391944 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.391928    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca\") pod \"image-registry-7659844d84-4hwr6\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") " pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:20.393552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.393533    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8l2r\" (UniqueName: \"kubernetes.io/projected/e4efa2f2-5d48-40f5-bfc2-d4f858a4c387-kube-api-access-t8l2r\") pod \"console-operator-7cd56b8dbc-8hk9c\" (UID: \"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:20.404268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404245    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-sys\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.404330 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404270    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-socket-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.404330 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404287    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-log-socket\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.404405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404334    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-kubelet-config\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:20.404405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404354    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-modprobe-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.404405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404367    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-sys\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.404405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404367    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-log-socket\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.404405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404396    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-kubernetes\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404412    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-kubelet-config\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404422    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-system-cni-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404372    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-socket-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404438    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-kubernetes\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404459    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-slash\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404478    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-system-cni-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404480    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cnibin\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404514    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-slash\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404527    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-modprobe-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404540    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-cnibin\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404552    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-etc-selinux\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404607    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-etc-kubernetes\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.404622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404617    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-etc-selinux\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404631    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-node-log\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404648    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404665    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-conf\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404678    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-systemd\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404675    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-etc-kubernetes\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404693    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404714    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-conf-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404753    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-node-log\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404775    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-netns\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404797    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-conf-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404800    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404825    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-conf\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404837    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-run\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404830    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404848    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-run-netns\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404853    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysctl-d\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404863    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404863    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404763    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-systemd\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404893    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-run\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404903    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404911    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-bin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404938    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-host-slash\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404955    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysconfig\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.404998    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-bin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405013    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-etc-sysconfig\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405016    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/822b5a15-b6cd-4106-b4c7-76ae8d6db19a-host-slash\") pod \"iptables-alerter-25zhv\" (UID: \"822b5a15-b6cd-4106-b4c7-76ae8d6db19a\") " pod="openshift-network-operator/iptables-alerter-25zhv"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405047    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-multus-certs\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405072    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-host\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405082    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-multus-certs\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405096    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-socket-dir-parent\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405118    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bfa550e-e2f4-4549-993f-5bbe3ebac5c2-host\") pod \"node-ca-k4gdh\" (UID: \"6bfa550e-e2f4-4549-993f-5bbe3ebac5c2\") " pod="openshift-image-registry/node-ca-k4gdh"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405119    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-netns\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405143    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-bin\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405167    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-registration-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405181    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-netns\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.405170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405188    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-system-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405200    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-bin\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405219    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-kubelet\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405167    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-multus-socket-dir-parent\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405258    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-registration-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405240    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-system-cni-dir\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405273    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-ovn\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405271    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-kubelet\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405246    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-ovn\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405328    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405354    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405377    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-lib-modules\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405384    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405405    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-etc-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405430    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-systemd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405435    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7026bee2-54f0-43f2-aaeb-b7c81acd5e68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k4wl2\" (UID: \"7026bee2-54f0-43f2-aaeb-b7c81acd5e68\") " pod="openshift-multus/multus-additional-cni-plugins-k4wl2"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405441    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-etc-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405451    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-netd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405469    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-run-systemd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405473    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-dbus\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405476    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-lib-modules\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405494    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-sys-fs\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405495    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-cni-netd\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405534    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5515bc6-8312-4be8-999c-9072fa30b526-dbus\") pod \"global-pull-secret-syncer-s4z6n\" (UID: \"a5515bc6-8312-4be8-999c-9072fa30b526\") " pod="kube-system/global-pull-secret-syncer-s4z6n"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405557    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-multus\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405580    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-cni-multus\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405590    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-var-lib-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405610    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-sys-fs\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405617    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-kubelet\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405642    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64cf3434-1c3d-4036-9a55-4eb3958b16d4-crio-socket\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405665    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-cnibin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405673    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-var-lib-openvswitch\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405689    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-systemd-units\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405687    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-var-lib-kubelet\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405706    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-var-lib-kubelet\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405715    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-cnibin\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405717    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-systemd-units\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405729    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64cf3434-1c3d-4036-9a55-4eb3958b16d4-crio-socket\") pod \"insights-runtime-extractor-jbkhl\" (UID: \"64cf3434-1c3d-4036-9a55-4eb3958b16d4\") " pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405731    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-var-lib-kubelet\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405731    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2523fa7a-1747-4695-a737-5c2a1caf2864-hosts-file\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405767    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2523fa7a-1747-4695-a737-5c2a1caf2864-hosts-file\") pod \"node-resolver-cgnp7\" (UID: \"2523fa7a-1747-4695-a737-5c2a1caf2864\") " pod="openshift-dns/node-resolver-cgnp7"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405779    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405814    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-k8s-cni-cncf-io\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405847    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-device-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405815    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fef5d7-aeae-4377-b42a-18ca1db1aef4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsvj4\" (UID: \"b5fef5d7-aeae-4377-b42a-18ca1db1aef4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405872    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-host\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405907    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/204ffe78-eee5-4cf4-9eb3-23a4034a26af-host\") pod \"tuned-2gbd4\" (UID: \"204ffe78-eee5-4cf4-9eb3-23a4034a26af\") " pod="openshift-cluster-node-tuning-operator/tuned-2gbd4"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405916    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-hostroot\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405922    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-host-run-k8s-cni-cncf-io\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405922    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e60dadc-7b2d-47e1-930e-fbfb5a1c9534-device-dir\") pod \"aws-ebs-csi-driver-node-t29nn\" (UID: \"3e60dadc-7b2d-47e1-930e-fbfb5a1c9534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t29nn"
Oct 30 21:23:20.406484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.405946    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5816f96-8b2e-4f04-a675-500b2a4044df-hostroot\") pod \"multus-4p5ng\" (UID: \"a5816f96-8b2e-4f04-a675-500b2a4044df\") " pod="openshift-multus/multus-4p5ng"
Oct 30 21:23:20.457543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.457503    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:20.533347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.533328    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:20.534272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.534256    5575 scope.go:122] "RemoveContainer" containerID="8a19b13d667539386e0bf276e5822ee76936e8869fd3e3df8220508c53ab4513"
Oct 30 21:23:20.547900 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.547882    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jbkhl"
Oct 30 21:23:20.739929 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.739898    5575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:23:20.759551 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.759529    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:20.774493 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.774463    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:20.911371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:20.911344    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:21.189440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.189373    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbkhl" event={"ID":"64cf3434-1c3d-4036-9a55-4eb3958b16d4","Type":"ContainerStarted","Data":"f0f3a3fd90f949c9fbc09cc2aa2be83ccd988a816d5ed7b24b5dc401f1b368ad"}
Oct 30 21:23:21.189440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.189423    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbkhl" event={"ID":"64cf3434-1c3d-4036-9a55-4eb3958b16d4","Type":"ContainerStarted","Data":"205b7f1f571d14a8f325e7fefc350340a8315cd3f4a6f29c86c2f70fa80cdf47"}
Oct 30 21:23:21.190792 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.190768    5575 generic.go:356] "Generic (PLEG): container finished" podID="39c99098-aa34-4200-b2a4-2404ae1cd454" containerID="bc771fe37ec997994de94af77b20903b9538071b11eae7ab713f18c6833501e5" exitCode=0
Oct 30 21:23:21.190895 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.190831    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m" event={"ID":"39c99098-aa34-4200-b2a4-2404ae1cd454","Type":"ContainerDied","Data":"bc771fe37ec997994de94af77b20903b9538071b11eae7ab713f18c6833501e5"}
Oct 30 21:23:21.191157 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.191141    5575 scope.go:122] "RemoveContainer" containerID="bc771fe37ec997994de94af77b20903b9538071b11eae7ab713f18c6833501e5"
Oct 30 21:23:21.192342 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.192322    5575 generic.go:356] "Generic (PLEG): container finished" podID="db22bba6-c4a6-4ff0-8c60-60f0c4e61864" containerID="3f99d5b2ec87e8e4a9790bc762d38f791059db53b92b77faebd8332491e4766d" exitCode=0
Oct 30 21:23:21.192438 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.192389    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-2thg2" event={"ID":"db22bba6-c4a6-4ff0-8c60-60f0c4e61864","Type":"ContainerDied","Data":"3f99d5b2ec87e8e4a9790bc762d38f791059db53b92b77faebd8332491e4766d"}
Oct 30 21:23:21.192653 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.192628    5575 scope.go:122] "RemoveContainer" containerID="3f99d5b2ec87e8e4a9790bc762d38f791059db53b92b77faebd8332491e4766d"
Oct 30 21:23:21.194215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.194200    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:23:21.194334 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.194317    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c" event={"ID":"e4efa2f2-5d48-40f5-bfc2-d4f858a4c387","Type":"ContainerStarted","Data":"1262550f69605ded02f3f477966f3462f72e6a61944f11425b0e7289bd1526fc"}
Oct 30 21:23:21.194479 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.194452    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:21.196156 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.196122    5575 generic.go:356] "Generic (PLEG): container finished" podID="23e2e6b5-2a6a-4d14-ad7a-784442fd6960" containerID="6108f79bc49415ca38c245a953fd04347862b610e5975fa24c71feb80e026ced" exitCode=0
Oct 30 21:23:21.196244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.196186    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg" event={"ID":"23e2e6b5-2a6a-4d14-ad7a-784442fd6960","Type":"ContainerDied","Data":"6108f79bc49415ca38c245a953fd04347862b610e5975fa24c71feb80e026ced"}
Oct 30 21:23:21.196548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.196525    5575 scope.go:122] "RemoveContainer" containerID="6108f79bc49415ca38c245a953fd04347862b610e5975fa24c71feb80e026ced"
Oct 30 21:23:21.302181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.302153    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hk9c"
Oct 30 21:23:21.534630 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.534567    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:21.809455 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.809363    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:21.977224 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:21.977189    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:22.005981 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:22.005933    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:22.158249 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:22.158209    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:22.203147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:22.203098    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-2thg2" event={"ID":"db22bba6-c4a6-4ff0-8c60-60f0c4e61864","Type":"ContainerStarted","Data":"13e4517262148b34a31902a512a8598cab55c271a55ad577338fd8162b298c09"}
Oct 30 21:23:22.205501 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:22.205467    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-v5fxg" event={"ID":"23e2e6b5-2a6a-4d14-ad7a-784442fd6960","Type":"ContainerStarted","Data":"2a4fcdeeedf3a758ecac06a9a66ca27ce9ddb240e205ef0f4b2cba1dffd7fd79"}
Oct 30 21:23:22.207575 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:22.207550    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-f5b5m" event={"ID":"39c99098-aa34-4200-b2a4-2404ae1cd454","Type":"ContainerStarted","Data":"055aeec4f806c92d5cf2cdc28c4b84908225617b2c029d146755c7198f2bb961"}
Oct 30 21:23:22.318550 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:22.318513    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:22.978489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:22.978449    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:22.978688 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:22.978676    5575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:23:23.030028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:23.029945    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:23.137781 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:23.137757    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:23.213626 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:23.213597    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbkhl" event={"ID":"64cf3434-1c3d-4036-9a55-4eb3958b16d4","Type":"ContainerStarted","Data":"4d1e203853b86eba3a5c6853e2b2ef7afea0076f7395e45cf89bcf3b8b08683e"}
Oct 30 21:23:24.583985 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:24.583940    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:24.738050 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:24.738021    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:25.222589 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:25.222555    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbkhl" event={"ID":"64cf3434-1c3d-4036-9a55-4eb3958b16d4","Type":"ContainerStarted","Data":"eaccf62e3bd59f72451b95d98aec661455cfda719a85d719ba7a110b25338808"}
Oct 30 21:23:26.051128 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.051095    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:26.051535 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.051216    5575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:23:26.052370 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.052349    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66bc45fc97-b8kwb"
Oct 30 21:23:26.135459 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.135430    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qm2pw"
Oct 30 21:23:26.140475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.140452    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7fr7k"
Oct 30 21:23:26.187438 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.187413    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5szpn"
Oct 30 21:23:26.206732 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.206696    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:26.379989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.379905    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:26.385450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.385427    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:26.389825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.389794    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:26.541455 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.541423    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:26.709428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.709397    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:26.889915 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.889881    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:26.946108 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.946079    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p6mf4"]
Oct 30 21:23:26.948230 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:26.948215    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.003189 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.003117    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 21:23:27.051775 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.051751    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 21:23:27.056856 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.056831    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.056933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.056875    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-textfile\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.056997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.056923    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-wtmp\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.056997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.056989    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt24v\" (UniqueName: \"kubernetes.io/projected/16aa748d-0848-4d35-8522-527ce83ab9bb-kube-api-access-gt24v\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.057122 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.057101    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.057159 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.057138    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16aa748d-0848-4d35-8522-527ce83ab9bb-metrics-client-ca\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.057206 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.057164    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16aa748d-0848-4d35-8522-527ce83ab9bb-root\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.057306 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.057289    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-tls\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.057362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.057328    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16aa748d-0848-4d35-8522-527ce83ab9bb-sys\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.074862 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.074842    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 21:23:27.074862 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.074862    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pvd8m\""
Oct 30 21:23:27.075031 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.074932    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 21:23:27.083885 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.083848    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:27.157842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.157806    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16aa748d-0848-4d35-8522-527ce83ab9bb-metrics-client-ca\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.157842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.157839    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16aa748d-0848-4d35-8522-527ce83ab9bb-root\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.157911    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16aa748d-0848-4d35-8522-527ce83ab9bb-root\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.157979    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-tls\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158025    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16aa748d-0848-4d35-8522-527ce83ab9bb-sys\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158080    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158315 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158107    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-textfile\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158315 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158115    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16aa748d-0848-4d35-8522-527ce83ab9bb-sys\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158315 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158134    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-wtmp\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158315 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158157    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt24v\" (UniqueName: \"kubernetes.io/projected/16aa748d-0848-4d35-8522-527ce83ab9bb-kube-api-access-gt24v\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158315 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158199    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158365    5575 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:23:27.158573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158410    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-wtmp\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158443    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16aa748d-0848-4d35-8522-527ce83ab9bb-metrics-client-ca\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158485    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-textfile\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.158813 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.158793    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.160635 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.160606    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.160746 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.160667    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16aa748d-0848-4d35-8522-527ce83ab9bb-node-exporter-tls\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.224217 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.224186    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt24v\" (UniqueName: \"kubernetes.io/projected/16aa748d-0848-4d35-8522-527ce83ab9bb-kube-api-access-gt24v\") pod \"node-exporter-p6mf4\" (UID: \"16aa748d-0848-4d35-8522-527ce83ab9bb\") " pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.272329 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.272050    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p6mf4"
Oct 30 21:23:27.289425 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.289394    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:27.296116 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:23:27.296093    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16aa748d_0848_4d35_8522_527ce83ab9bb.slice/crio-de03cdf35e574c2ac099e48d7da2556a6532e517310a6e9ac0da9d3f45f57b94 WatchSource:0}: Error finding container de03cdf35e574c2ac099e48d7da2556a6532e517310a6e9ac0da9d3f45f57b94: Status 404 returned error can't find the container with id de03cdf35e574c2ac099e48d7da2556a6532e517310a6e9ac0da9d3f45f57b94
Oct 30 21:23:27.473163 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.473128    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:27.681177 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.681150    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:27.861088 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:27.861045    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:28.236603 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:28.236556    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p6mf4" event={"ID":"16aa748d-0848-4d35-8522-527ce83ab9bb","Type":"ContainerStarted","Data":"de03cdf35e574c2ac099e48d7da2556a6532e517310a6e9ac0da9d3f45f57b94"}
Oct 30 21:23:28.419908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:28.419875    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:28.692497 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:28.692461    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:29.224521 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:29.224496    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:29.244354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:29.242672    5575 generic.go:356] "Generic (PLEG): container finished" podID="16aa748d-0848-4d35-8522-527ce83ab9bb" containerID="1392be9a39ec443e25d3f5c2d291507ea738dceb785a7071a6b0435c80e090ec" exitCode=0
Oct 30 21:23:29.244354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:29.242767    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p6mf4" event={"ID":"16aa748d-0848-4d35-8522-527ce83ab9bb","Type":"ContainerDied","Data":"1392be9a39ec443e25d3f5c2d291507ea738dceb785a7071a6b0435c80e090ec"}
Oct 30 21:23:29.441234 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:29.441197    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:29.607347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:29.607279    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:29.836112 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:29.836083    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7659844d84-4hwr6"]
Oct 30 21:23:29.891135 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:29.891109    5575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-135.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:23:29.977366 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:29.977332    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:30.157439 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:30.157367    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:30.248738 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:30.248709    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p6mf4" event={"ID":"16aa748d-0848-4d35-8522-527ce83ab9bb","Type":"ContainerStarted","Data":"38c2f2fecd47066e49d53b2dcf14375100e2b56d7a3f8d3ef91ae15f7c5f5611"}
Oct 30 21:23:30.249133 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:30.248755    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p6mf4" event={"ID":"16aa748d-0848-4d35-8522-527ce83ab9bb","Type":"ContainerStarted","Data":"b1f83ad0095466359f656af5a8836f0aec15cd55f7d711862e690c9c2266a454"}
Oct 30 21:23:30.313575 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:30.313548    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:30.371533 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:30.371490    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p6mf4" podStartSLOduration=2.802731187 podStartE2EDuration="4.371477869s" totalImagesPullingTime="1.494124014s" totalInitContainerRuntime="74.622668ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:30.370785178 +0000 UTC m=+11.402633715" watchObservedRunningTime="2026-10-30 21:23:30.371477869 +0000 UTC m=+11.403326446"
Oct 30 21:23:31.202783 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:31.202758    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:31.472842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:31.472762    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:31.643268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:31.643225    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:31.821438 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:31.821367    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:35.170267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:35.170237    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:35.347286 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:35.347254    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:35.882868 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:35.882839    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bc45fc97-b8kwb_0dae4f31-8ea9-480a-881f-61bad1def6bc/router/0.log"
Oct 30 21:23:36.095406 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:36.095373    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g8nnl_eb9de1fa-933d-49a5-84ed-2418c40eead3/serve-healthcheck-canary/0.log"
Oct 30 21:23:36.236595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:36.236520    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:36.284617 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:36.284586    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6ddb6c8b94-57r7x_a0747bf5-ca98-4d2c-9723-3c226817ee66/cluster-samples-operator/0.log"
Oct 30 21:23:36.393659 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:36.393629    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6ddb6c8b94-57r7x_a0747bf5-ca98-4d2c-9723-3c226817ee66/cluster-samples-operator-watch/0.log"
Oct 30 21:23:37.473556 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:37.473516    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:37.698902 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:37.698869    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:38.763561 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:38.763520    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:38.920728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:38.920697    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:40.282024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:40.281953    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:40.536586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:40.536517    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:41.383767 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:41.383733    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:41.543664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:41.543627    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:41.724939 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:41.724869    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsvj4"
Oct 30 21:23:42.691785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:42.691753    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:42.841179 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:42.841154    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:44.169590 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:44.169558    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:44.336276 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:44.336251    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:53.484671 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:53.484619    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:23:54.855957 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:54.855896    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7659844d84-4hwr6" podUID="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" containerName="registry" containerID="cri-o://322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72" gracePeriod=30
Oct 30 21:23:55.131315 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.131287    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:55.279918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.279497    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx\") pod \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") "
Oct 30 21:23:55.279918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.279568    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates\") pod \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") "
Oct 30 21:23:55.279918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.279627    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token\") pod \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") "
Oct 30 21:23:55.279918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.279675    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted\") pod \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") "
Oct 30 21:23:55.279918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.279709    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration\") pod \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") "
Oct 30 21:23:55.279918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.279759    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") pod \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") "
Oct 30 21:23:55.279918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.279805    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets\") pod \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") "
Oct 30 21:23:55.279918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.279838    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca\") pod \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\" (UID: \"8ecfcbcb-28ea-40cf-825b-5b01330c18e9\") "
Oct 30 21:23:55.280548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.280373    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca" pod "8ecfcbcb-28ea-40cf-825b-5b01330c18e9" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:55.282734 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.282600    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx" pod "8ecfcbcb-28ea-40cf-825b-5b01330c18e9" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9"). InnerVolumeSpecName "kube-api-access-jf2dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:55.284267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.284231    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates" pod "8ecfcbcb-28ea-40cf-825b-5b01330c18e9" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:55.284510 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.284486    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token" pod "8ecfcbcb-28ea-40cf-825b-5b01330c18e9" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:55.284620 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.284586    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls" pod "8ecfcbcb-28ea-40cf-825b-5b01330c18e9" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:55.284620 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.284591    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets" pod "8ecfcbcb-28ea-40cf-825b-5b01330c18e9" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:23:55.284747 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.284691    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration" pod "8ecfcbcb-28ea-40cf-825b-5b01330c18e9" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:23:55.298654 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.298588    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted" pod "8ecfcbcb-28ea-40cf-825b-5b01330c18e9" (UID: "8ecfcbcb-28ea-40cf-825b-5b01330c18e9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:55.341677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.341628    5575 generic.go:356] "Generic (PLEG): container finished" podID="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" containerID="322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72" exitCode=0
Oct 30 21:23:55.341850 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.341751    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7659844d84-4hwr6" event={"ID":"8ecfcbcb-28ea-40cf-825b-5b01330c18e9","Type":"ContainerDied","Data":"322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72"}
Oct 30 21:23:55.341850 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.341803    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7659844d84-4hwr6" event={"ID":"8ecfcbcb-28ea-40cf-825b-5b01330c18e9","Type":"ContainerDied","Data":"c117e5da23d812319064ebe402a785391e922e428ef375b1067c386291417f14"}
Oct 30 21:23:55.341850 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.341848    5575 scope.go:122] "RemoveContainer" containerID="322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72"
Oct 30 21:23:55.342062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.342024    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7659844d84-4hwr6"
Oct 30 21:23:55.358786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.358765    5575 scope.go:122] "RemoveContainer" containerID="322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72"
Oct 30 21:23:55.359101 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:23:55.359072    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72\": container with ID starting with 322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72 not found: ID does not exist" containerID="322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72"
Oct 30 21:23:55.359203 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.359112    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72"} err="failed to get container status \"322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72\": rpc error: code = NotFound desc = could not find container \"322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72\": container with ID starting with 322b82c21a95bb8930c9cdedb0f1aaa9e602ea95b0249e1893bea9515832db72 not found: ID does not exist"
Oct 30 21:23:55.381611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.381199    5575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-certificates\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.381611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.381233    5575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-bound-sa-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.381611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.381249    5575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-ca-trust-extracted\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.381611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.381265    5575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-image-registry-private-configuration\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.381611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.381280    5575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-registry-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.381611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.381293    5575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-installation-pull-secrets\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.381611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.381307    5575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-trusted-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.381611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.381319    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf2dx\" (UniqueName: \"kubernetes.io/projected/8ecfcbcb-28ea-40cf-825b-5b01330c18e9-kube-api-access-jf2dx\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.508589 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.508551    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7659844d84-4hwr6"]
Oct 30 21:23:55.513137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.513109    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7659844d84-4hwr6"]
Oct 30 21:23:55.933415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:55.933375    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:56.109030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:56.109000    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:56.279477 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:56.279405    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:57.123188 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:57.123156    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" path="/var/lib/kubelet/pods/8ecfcbcb-28ea-40cf-825b-5b01330c18e9/volumes"
Oct 30 21:23:57.736564 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:57.736526    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:57.888829 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:57.888800    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:58.173528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:58.173503    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:58.340099 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:23:58.340070    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:00.980370 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:00.980336    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:01.128627 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:01.128585    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:12.799152 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:12.799120    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:12.960017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:12.959981    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:13.354833 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:13.354765    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:13.519038 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:13.519001    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:22.796105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:22.796069    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:23.484391 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:24:23.484359    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:24:23.679428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:23.679399    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:27.692576 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:27.692544    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:27.844456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:27.844424    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:39.596024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:39.595987    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:40.631898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:40.631863    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:53.483380 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:24:53.483344    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:24:55.690426 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:55.690392    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:56.602994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:24:56.602948    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:06.044985 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:25:06.044933    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:06.203851 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:25:06.203816    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:22.885275 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:25:22.885236    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:23.041625 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:25:23.041590    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:23.485022 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:25:23.484990    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:25:34.606449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:25:34.606414    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:40.991625 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:25:40.991592    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:51.577032 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:25:51.576993    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:51.744979 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:25:51.744927    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:53.483925 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:25:53.483888    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:26:13.715946 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:13.715912    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:13.899655 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:13.899626    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:15.280205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:15.280169    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:15.446071 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:15.446040    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:16.341013 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.340959    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"]
Oct 30 21:26:16.341403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.341248    5575 cpu_manager.go:414] "containerMap: removing container" podUID="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" containerName="registry"
Oct 30 21:26:16.341403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.341258    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" containerName="registry"
Oct 30 21:26:16.341403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.341330    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ecfcbcb-28ea-40cf-825b-5b01330c18e9" containerName="registry"
Oct 30 21:26:16.344341 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.344324    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.361127 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.361106    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.361231 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.361133    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.361231 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.361221    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9xd5\" (UniqueName: \"kubernetes.io/projected/5fce63a6-0602-4a22-90ab-8e2fbe809cab-kube-api-access-h9xd5\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.396871 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.396827    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 21:26:16.446954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.446927    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 21:26:16.447089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.446960    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-rljmb\""
Oct 30 21:26:16.447805 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.447788    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"]
Oct 30 21:26:16.448336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.448312    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"]
Oct 30 21:26:16.451645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.451602    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.461887 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.461867    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xd5\" (UniqueName: \"kubernetes.io/projected/5fce63a6-0602-4a22-90ab-8e2fbe809cab-kube-api-access-h9xd5\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.462001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.461898    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnfq5\" (UniqueName: \"kubernetes.io/projected/5352e843-2833-4330-8e32-2055b23944b0-kube-api-access-qnfq5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.462001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.461923    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.462001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.461940    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.462165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.462011    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.462218 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.462188    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.462349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.462333    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.462388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.462339    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.504384 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.504366    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-82c7l\""
Oct 30 21:26:16.515268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.515246    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"]
Oct 30 21:26:16.523345 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.523324    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9xd5\" (UniqueName: \"kubernetes.io/projected/5fce63a6-0602-4a22-90ab-8e2fbe809cab-kube-api-access-h9xd5\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.541702 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.541677    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"]
Oct 30 21:26:16.544950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.544935    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.562503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.562482    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.562583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.562520    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.562583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.562546    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.562651 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.562586    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.562651 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.562618    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs4g5\" (UniqueName: \"kubernetes.io/projected/905463aa-ad39-43cf-8816-19891550eae5-kube-api-access-qs4g5\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.562791 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.562768    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnfq5\" (UniqueName: \"kubernetes.io/projected/5352e843-2833-4330-8e32-2055b23944b0-kube-api-access-qnfq5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.562874 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.562860    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.562911 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.562858    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.602931 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.602889    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"]
Oct 30 21:26:16.604408 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.604388    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-knhn5\""
Oct 30 21:26:16.626270 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.626252    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnfq5\" (UniqueName: \"kubernetes.io/projected/5352e843-2833-4330-8e32-2055b23944b0-kube-api-access-qnfq5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.639721 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.639700    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"]
Oct 30 21:26:16.642973 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.642948    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.655513 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.655492    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:16.659361 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.659346    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:26:16.664098 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.664076    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs4g5\" (UniqueName: \"kubernetes.io/projected/905463aa-ad39-43cf-8816-19891550eae5-kube-api-access-qs4g5\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.664183 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.664119    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fksgv\" (UniqueName: \"kubernetes.io/projected/28107625-e680-4391-a6d7-247d1ea92918-kube-api-access-fksgv\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.664183 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.664149    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.664355 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.664336    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.664414 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.664363    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.664466 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.664451    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.664547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.664528    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.664669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.664655    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.701921 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.701890    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"]
Oct 30 21:26:16.704811 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.704785    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-4w9jr\""
Oct 30 21:26:16.728131 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.728074    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs4g5\" (UniqueName: \"kubernetes.io/projected/905463aa-ad39-43cf-8816-19891550eae5-kube-api-access-qs4g5\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.742656 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.742627    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"]
Oct 30 21:26:16.747677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.747658    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.765402 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.765377    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.765506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.765419    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fksgv\" (UniqueName: \"kubernetes.io/projected/28107625-e680-4391-a6d7-247d1ea92918-kube-api-access-fksgv\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.765506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.765439    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.765628 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.765498    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.765628 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.765546    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rjs\" (UniqueName: \"kubernetes.io/projected/60d92dcf-f112-4dba-baeb-038fa2571688-kube-api-access-n8rjs\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.765628 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.765589    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.765792 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.765778    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.765830 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.765816    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.766307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.766292    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:26:16.805082 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.805052    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"]
Oct 30 21:26:16.807250 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.807225    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-rjl5v\""
Oct 30 21:26:16.829207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.829184    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fksgv\" (UniqueName: \"kubernetes.io/projected/28107625-e680-4391-a6d7-247d1ea92918-kube-api-access-fksgv\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:16.860008 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.859946    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:26:16.866115 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.866099    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.866205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.866145    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rjs\" (UniqueName: \"kubernetes.io/projected/60d92dcf-f112-4dba-baeb-038fa2571688-kube-api-access-n8rjs\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.866205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.866170    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.866495 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.866472    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.866563 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.866514    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.927442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.927415    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rjs\" (UniqueName: \"kubernetes.io/projected/60d92dcf-f112-4dba-baeb-038fa2571688-kube-api-access-n8rjs\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:16.958485 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:16.958461    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:26:17.064592 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.064564    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:26:17.081568 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.081544    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"]
Oct 30 21:26:17.083950 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:17.083919    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fce63a6_0602_4a22_90ab_8e2fbe809cab.slice/crio-6f9cb24203c8f072d46ada638775890c37711eb4e7cefc6faeaf7f0d998547a8 WatchSource:0}: Error finding container 6f9cb24203c8f072d46ada638775890c37711eb4e7cefc6faeaf7f0d998547a8: Status 404 returned error can't find the container with id 6f9cb24203c8f072d46ada638775890c37711eb4e7cefc6faeaf7f0d998547a8
Oct 30 21:26:17.137368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.137342    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"]
Oct 30 21:26:17.140654 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:17.140629    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5352e843_2833_4330_8e32_2055b23944b0.slice/crio-e050bd76a5a908ee0c837dc5b952a0eb9fd71d6c314ebaf6c4436d779df42270 WatchSource:0}: Error finding container e050bd76a5a908ee0c837dc5b952a0eb9fd71d6c314ebaf6c4436d779df42270: Status 404 returned error can't find the container with id e050bd76a5a908ee0c837dc5b952a0eb9fd71d6c314ebaf6c4436d779df42270
Oct 30 21:26:17.228835 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.228772    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"]
Oct 30 21:26:17.232249 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:17.232226    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905463aa_ad39_43cf_8816_19891550eae5.slice/crio-97b757b59ed1cd657dd09b185bfbccda14be452a6591d87ea7e07450c3c3e36f WatchSource:0}: Error finding container 97b757b59ed1cd657dd09b185bfbccda14be452a6591d87ea7e07450c3c3e36f: Status 404 returned error can't find the container with id 97b757b59ed1cd657dd09b185bfbccda14be452a6591d87ea7e07450c3c3e36f
Oct 30 21:26:17.312614 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.312589    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"]
Oct 30 21:26:17.317269 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.317249    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.328163 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.328131    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"]
Oct 30 21:26:17.330433 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:17.330413    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28107625_e680_4391_a6d7_247d1ea92918.slice/crio-61abbaf5af55574149a34ed2538d9bc4a7465ffca2139132680ef7b573e4980b WatchSource:0}: Error finding container 61abbaf5af55574149a34ed2538d9bc4a7465ffca2139132680ef7b573e4980b: Status 404 returned error can't find the container with id 61abbaf5af55574149a34ed2538d9bc4a7465ffca2139132680ef7b573e4980b
Oct 30 21:26:17.370701 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.370638    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.370701 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.370653    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-tnt2c\""
Oct 30 21:26:17.371067 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.370708    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.371067 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.370810    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx2mf\" (UniqueName: \"kubernetes.io/projected/f9702ac2-3b8f-427d-8d11-59803ff043d0-kube-api-access-dx2mf\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.375068 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.375045    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"]
Oct 30 21:26:17.436734 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.436711    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"]
Oct 30 21:26:17.439524 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:17.439500    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d92dcf_f112_4dba_baeb_038fa2571688.slice/crio-2c9ebcb09ca2afa60758e10efa608ae5e5cee4fdf31190b9cf939f0da587fd87 WatchSource:0}: Error finding container 2c9ebcb09ca2afa60758e10efa608ae5e5cee4fdf31190b9cf939f0da587fd87: Status 404 returned error can't find the container with id 2c9ebcb09ca2afa60758e10efa608ae5e5cee4fdf31190b9cf939f0da587fd87
Oct 30 21:26:17.471412 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.471388    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx2mf\" (UniqueName: \"kubernetes.io/projected/f9702ac2-3b8f-427d-8d11-59803ff043d0-kube-api-access-dx2mf\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.471494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.471432    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.471494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.471471    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.471762 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.471749    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.471798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.471788    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.533055 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.533031    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx2mf\" (UniqueName: \"kubernetes.io/projected/f9702ac2-3b8f-427d-8d11-59803ff043d0-kube-api-access-dx2mf\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.632589 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.632572    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:26:17.825931 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.825888    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x" event={"ID":"5352e843-2833-4330-8e32-2055b23944b0","Type":"ContainerStarted","Data":"e050bd76a5a908ee0c837dc5b952a0eb9fd71d6c314ebaf6c4436d779df42270"}
Oct 30 21:26:17.827054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.827034    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf" event={"ID":"5fce63a6-0602-4a22-90ab-8e2fbe809cab","Type":"ContainerStarted","Data":"6f9cb24203c8f072d46ada638775890c37711eb4e7cefc6faeaf7f0d998547a8"}
Oct 30 21:26:17.828016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.827992    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8" event={"ID":"60d92dcf-f112-4dba-baeb-038fa2571688","Type":"ContainerStarted","Data":"2c9ebcb09ca2afa60758e10efa608ae5e5cee4fdf31190b9cf939f0da587fd87"}
Oct 30 21:26:17.829007 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.828988    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r" event={"ID":"905463aa-ad39-43cf-8816-19891550eae5","Type":"ContainerStarted","Data":"97b757b59ed1cd657dd09b185bfbccda14be452a6591d87ea7e07450c3c3e36f"}
Oct 30 21:26:17.829903 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:17.829884    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9" event={"ID":"28107625-e680-4391-a6d7-247d1ea92918","Type":"ContainerStarted","Data":"61abbaf5af55574149a34ed2538d9bc4a7465ffca2139132680ef7b573e4980b"}
Oct 30 21:26:18.002601 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:18.002533    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"]
Oct 30 21:26:18.007022 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:18.006994    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9702ac2_3b8f_427d_8d11_59803ff043d0.slice/crio-00a253cb4dfa9e4c87c62d6166f88bdce926f63733829d4d17737d7025d39d0b WatchSource:0}: Error finding container 00a253cb4dfa9e4c87c62d6166f88bdce926f63733829d4d17737d7025d39d0b: Status 404 returned error can't find the container with id 00a253cb4dfa9e4c87c62d6166f88bdce926f63733829d4d17737d7025d39d0b
Oct 30 21:26:18.837896 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:18.837819    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk" event={"ID":"f9702ac2-3b8f-427d-8d11-59803ff043d0","Type":"ContainerStarted","Data":"00a253cb4dfa9e4c87c62d6166f88bdce926f63733829d4d17737d7025d39d0b"}
Oct 30 21:26:19.666304 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:19.666269    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:20.493224 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.491334    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"]
Oct 30 21:26:20.495694 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.495668    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.599003 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.598941    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.599189 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.599072    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8t2l\" (UniqueName: \"kubernetes.io/projected/6c04fe71-28c8-411f-85af-e352900a218e-kube-api-access-v8t2l\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.599189 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.599141    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.600369 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.600305    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-9d662\""
Oct 30 21:26:20.600879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.600857    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"]
Oct 30 21:26:20.701679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.700577    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.701679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.700622    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8t2l\" (UniqueName: \"kubernetes.io/projected/6c04fe71-28c8-411f-85af-e352900a218e-kube-api-access-v8t2l\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.701679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.700700    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.701679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.701125    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.701679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.701361    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.767767 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.767557    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8t2l\" (UniqueName: \"kubernetes.io/projected/6c04fe71-28c8-411f-85af-e352900a218e-kube-api-access-v8t2l\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:20.823607 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:20.823355    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:26:21.318751 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:21.318717    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"]
Oct 30 21:26:21.329267 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:21.329239    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c04fe71_28c8_411f_85af_e352900a218e.slice/crio-9dd818cdee8c3656dadaee4af4d82d50a19d29013efe677d69c608ad0592ae18 WatchSource:0}: Error finding container 9dd818cdee8c3656dadaee4af4d82d50a19d29013efe677d69c608ad0592ae18: Status 404 returned error can't find the container with id 9dd818cdee8c3656dadaee4af4d82d50a19d29013efe677d69c608ad0592ae18
Oct 30 21:26:21.362535 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:21.362479    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:21.518098 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:21.518047    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:21.861560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:21.861522    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch" event={"ID":"6c04fe71-28c8-411f-85af-e352900a218e","Type":"ContainerStarted","Data":"9dd818cdee8c3656dadaee4af4d82d50a19d29013efe677d69c608ad0592ae18"}
Oct 30 21:26:22.906456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:22.906427    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"]
Oct 30 21:26:22.911076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:22.911048    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:22.959003 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:22.957054    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"]
Oct 30 21:26:22.961494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:22.961468    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:22.963575 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:22.963552    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 21:26:22.979234 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:22.979144    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:23.005503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.005480    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lfxgk\""
Oct 30 21:26:23.007360 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.007338    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"]
Oct 30 21:26:23.011945 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.011606    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.025151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.024292    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"]
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034616    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034652    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034700    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034747    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034788    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034815    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm8m4\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-kube-api-access-cm8m4\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034858    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034896    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034934    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.034981    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.035007    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.035707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.035035    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kgjd\" (UniqueName: \"kubernetes.io/projected/fe516e24-69ef-41c6-8725-2f515de71b8b-kube-api-access-5kgjd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.053010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.051334    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"]
Oct 30 21:26:23.053010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.051387    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"]
Oct 30 21:26:23.058225 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.058204    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.058659 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.058634    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"]
Oct 30 21:26:23.063131 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.063017    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.066936 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.066911    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"]
Oct 30 21:26:23.115998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.115948    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"]
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.139312    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"]
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.141692    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.141732    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.141769    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.141807    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.141837    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.141862    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kgjd\" (UniqueName: \"kubernetes.io/projected/fe516e24-69ef-41c6-8725-2f515de71b8b-kube-api-access-5kgjd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.141906    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.141932    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.142001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.141984    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx7nh\" (UniqueName: \"kubernetes.io/projected/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-kube-api-access-bx7nh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142021    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv2kg\" (UniqueName: \"kubernetes.io/projected/fbadad89-60da-48ae-8c21-2f6d859be832-kube-api-access-lv2kg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142058    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142093    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142133    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142164    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142207    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142241    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142285    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhbz5\" (UniqueName: \"kubernetes.io/projected/50a0052b-8480-486c-ac55-b5fbb7fa0139-kube-api-access-zhbz5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142321    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142350    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm8m4\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-kube-api-access-cm8m4\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142385    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.142523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142425    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.143088 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.142876    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.146644 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.143243    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.146644 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.143479    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.146644 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.144062    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.146644 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.144347    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.146644 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.144571    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.146644 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.145039    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.180288 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.180201    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.183930 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.183876    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.188480 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.186741    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"]
Oct 30 21:26:23.191928 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.191908    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.217243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.217219    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kgjd\" (UniqueName: \"kubernetes.io/projected/fe516e24-69ef-41c6-8725-2f515de71b8b-kube-api-access-5kgjd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.219062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.219009    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm8m4\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-kube-api-access-cm8m4\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.231925 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.228536    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-6q26d\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.231925 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.229319    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:23.243584 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.243555    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx7nh\" (UniqueName: \"kubernetes.io/projected/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-kube-api-access-bx7nh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.243702 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.243602    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv2kg\" (UniqueName: \"kubernetes.io/projected/fbadad89-60da-48ae-8c21-2f6d859be832-kube-api-access-lv2kg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.243702 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.243635    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.243702 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.243669    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.243702 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.243695    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.243908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.243728    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.243908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.243757    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.244483 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.244287    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.244483 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.244426    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.245087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.244781    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-xlwzd\""
Oct 30 21:26:23.245087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.244995    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.245087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245056    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.245250 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.243792    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.245366 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245292    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhbz5\" (UniqueName: \"kubernetes.io/projected/50a0052b-8480-486c-ac55-b5fbb7fa0139-kube-api-access-zhbz5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.245366 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245322    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.245366 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245341    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.245366 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245362    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.245580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245383    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.245580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245397    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.245580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245413    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.245580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245435    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q8g7\" (UniqueName: \"kubernetes.io/projected/2dfb6114-d082-4b6c-8198-5b8d3a13601c-kube-api-access-6q8g7\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.245580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245465    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.245580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245483    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.245926 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.245908    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.246256 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.246205    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.253724 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.253699    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"]
Oct 30 21:26:23.254566 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.254533    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:23.283643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.283618    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:26:23.309728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.309628    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv2kg\" (UniqueName: \"kubernetes.io/projected/fbadad89-60da-48ae-8c21-2f6d859be832-kube-api-access-lv2kg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.310458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.310414    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx7nh\" (UniqueName: \"kubernetes.io/projected/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-kube-api-access-bx7nh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.321120 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.321073    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhbz5\" (UniqueName: \"kubernetes.io/projected/50a0052b-8480-486c-ac55-b5fbb7fa0139-kube-api-access-zhbz5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.346129    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q8g7\" (UniqueName: \"kubernetes.io/projected/2dfb6114-d082-4b6c-8198-5b8d3a13601c-kube-api-access-6q8g7\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.346190    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.346235    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.346282    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.346333    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.346359    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.346390    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.346420    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.346445    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.347145    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.347956    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.348201    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.348449    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.349458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.348722    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.353288 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.353239    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.358327 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.357775    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:26:23.358327 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.358165    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.412350 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.387701    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:26:23.412350 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.388807    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:26:23.413234 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.413179    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dfb6114-d082-4b6c-8198-5b8d3a13601c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.416642 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.416590    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q8g7\" (UniqueName: \"kubernetes.io/projected/2dfb6114-d082-4b6c-8198-5b8d3a13601c-kube-api-access-6q8g7\") pod \"openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc\" (UID: \"2dfb6114-d082-4b6c-8198-5b8d3a13601c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.423723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.423621    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:23.520000 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.514764    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:23.553134 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:26:23.553107    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:26:23.730302 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.730274    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"]
Oct 30 21:26:23.735040 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:23.735006    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe516e24_69ef_41c6_8725_2f515de71b8b.slice/crio-63b8b6b0bec9d5ed556adf39f11eaf6282035544c9f64aab7ba02c18be051d39 WatchSource:0}: Error finding container 63b8b6b0bec9d5ed556adf39f11eaf6282035544c9f64aab7ba02c18be051d39: Status 404 returned error can't find the container with id 63b8b6b0bec9d5ed556adf39f11eaf6282035544c9f64aab7ba02c18be051d39
Oct 30 21:26:23.768374 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.768345    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"]
Oct 30 21:26:23.775804 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:23.775769    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404ed8ef_1e29_490e_bd9a_1b8453b42f2a.slice/crio-07236defdcc0136d94322d1707be1b300fd3908d171357e0e9172f3581d8f8e9 WatchSource:0}: Error finding container 07236defdcc0136d94322d1707be1b300fd3908d171357e0e9172f3581d8f8e9: Status 404 returned error can't find the container with id 07236defdcc0136d94322d1707be1b300fd3908d171357e0e9172f3581d8f8e9
Oct 30 21:26:23.850673 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.850638    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"]
Oct 30 21:26:23.872860 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.872836    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"]
Oct 30 21:26:23.886313 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.886254    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r" event={"ID":"50a0052b-8480-486c-ac55-b5fbb7fa0139","Type":"ContainerStarted","Data":"970657788b47ad7bc60dd6b61bd971560dd8f732729e2a6bf989a9b5a616de40"}
Oct 30 21:26:23.893683 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.893635    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" event={"ID":"404ed8ef-1e29-490e-bd9a-1b8453b42f2a","Type":"ContainerStarted","Data":"07236defdcc0136d94322d1707be1b300fd3908d171357e0e9172f3581d8f8e9"}
Oct 30 21:26:23.898679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.898655    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"]
Oct 30 21:26:23.898843 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.898821    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c" event={"ID":"fe516e24-69ef-41c6-8725-2f515de71b8b","Type":"ContainerStarted","Data":"63b8b6b0bec9d5ed556adf39f11eaf6282035544c9f64aab7ba02c18be051d39"}
Oct 30 21:26:23.907406 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:23.907379    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c4cbb4_61e1_4aea_aa1c_4c7295592aaf.slice/crio-b0eecfbf32e690e27254f51081cc40c2bc19b14328610efa18783d8d469fbf96 WatchSource:0}: Error finding container b0eecfbf32e690e27254f51081cc40c2bc19b14328610efa18783d8d469fbf96: Status 404 returned error can't find the container with id b0eecfbf32e690e27254f51081cc40c2bc19b14328610efa18783d8d469fbf96
Oct 30 21:26:23.947350 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:23.946320    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"]
Oct 30 21:26:23.954558 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:26:23.954529    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dfb6114_d082_4b6c_8198_5b8d3a13601c.slice/crio-2fcd99127e3d560617980e5def3365ace991702f73fd7cdb5a9adfcfff47bed7 WatchSource:0}: Error finding container 2fcd99127e3d560617980e5def3365ace991702f73fd7cdb5a9adfcfff47bed7: Status 404 returned error can't find the container with id 2fcd99127e3d560617980e5def3365ace991702f73fd7cdb5a9adfcfff47bed7
Oct 30 21:26:24.925398 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:24.925360    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc" event={"ID":"2dfb6114-d082-4b6c-8198-5b8d3a13601c","Type":"ContainerStarted","Data":"2fcd99127e3d560617980e5def3365ace991702f73fd7cdb5a9adfcfff47bed7"}
Oct 30 21:26:24.934910 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:24.934823    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg" event={"ID":"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf","Type":"ContainerStarted","Data":"b0eecfbf32e690e27254f51081cc40c2bc19b14328610efa18783d8d469fbf96"}
Oct 30 21:26:24.940728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:24.940157    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft" event={"ID":"fbadad89-60da-48ae-8c21-2f6d859be832","Type":"ContainerStarted","Data":"884aa748b63484a001d7be376c809b1a515fceed9fe7fdc9521090efbe0c080b"}
Oct 30 21:26:27.047625 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:27.047519    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:37.438150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:37.437387    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:37.438150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:37.437476    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:37.438150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:37.437522    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:37.443368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:37.442802    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:37.443368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:37.442885    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:37.443368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:37.442930    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:38.087016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.085993    5575 generic.go:356] "Generic (PLEG): container finished" podID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerID="89f728b17c8a3347647f2b430473a1c735a56ce9b3e8e3ed4400ca96bcd902cb" exitCode=0
Oct 30 21:26:38.087016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.086093    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf" event={"ID":"5fce63a6-0602-4a22-90ab-8e2fbe809cab","Type":"ContainerDied","Data":"89f728b17c8a3347647f2b430473a1c735a56ce9b3e8e3ed4400ca96bcd902cb"}
Oct 30 21:26:38.102076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.101463    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" event={"ID":"404ed8ef-1e29-490e-bd9a-1b8453b42f2a","Type":"ContainerStarted","Data":"659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0"}
Oct 30 21:26:38.106782 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.106260    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc" event={"ID":"2dfb6114-d082-4b6c-8198-5b8d3a13601c","Type":"ContainerStarted","Data":"11d6e41a04bf5e641639b609c3276de2b672496619faf3326a917129839d7e06"}
Oct 30 21:26:38.230545 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.230517    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:38.230716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.230568    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:38.236524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.236474    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:38.342201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.340778    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc" podStartSLOduration=1.858209527 podStartE2EDuration="15.340762358s" totalImagesPullingTime="13.482552831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:38.340125512 +0000 UTC m=+199.371974064" watchObservedRunningTime="2026-10-30 21:26:38.340762358 +0000 UTC m=+199.372610895"
Oct 30 21:26:38.462659 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.462601    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" podStartSLOduration=2.804989925 podStartE2EDuration="16.462584566s" totalImagesPullingTime="13.657594641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:38.46064421 +0000 UTC m=+199.492492746" watchObservedRunningTime="2026-10-30 21:26:38.462584566 +0000 UTC m=+199.494433105"
Oct 30 21:26:38.516097 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.516063    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:38.516253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.516130    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:38.521713 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:38.521678    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:39.114675 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.114641    5575 generic.go:356] "Generic (PLEG): container finished" podID="28107625-e680-4391-a6d7-247d1ea92918" containerID="d211f6cbf714061ea1df6f26aa4da853d17474a0a4e4fc922437de6b4ff82c77" exitCode=0
Oct 30 21:26:39.114799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.114754    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9" event={"ID":"28107625-e680-4391-a6d7-247d1ea92918","Type":"ContainerDied","Data":"d211f6cbf714061ea1df6f26aa4da853d17474a0a4e4fc922437de6b4ff82c77"}
Oct 30 21:26:39.117238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.117208    5575 generic.go:356] "Generic (PLEG): container finished" podID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerID="d174ae6f77668276c134acab6c3d094452356be3696eed147482b6d0d0b2de56" exitCode=0
Oct 30 21:26:39.117343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.117295    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r" event={"ID":"50a0052b-8480-486c-ac55-b5fbb7fa0139","Type":"ContainerDied","Data":"d174ae6f77668276c134acab6c3d094452356be3696eed147482b6d0d0b2de56"}
Oct 30 21:26:39.119835 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.119768    5575 generic.go:356] "Generic (PLEG): container finished" podID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerID="ec72b5c4df2421e2bc47543c74a0e24661a713986da3b49269d2d5177b413c71" exitCode=0
Oct 30 21:26:39.121994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.121946    5575 generic.go:356] "Generic (PLEG): container finished" podID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerID="bcaba65ccf496f3ee624c2c52ba0d4f1cce786b5cf92d206a1c2d5df80ca970f" exitCode=0
Oct 30 21:26:39.124053 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.123955    5575 generic.go:356] "Generic (PLEG): container finished" podID="60d92dcf-f112-4dba-baeb-038fa2571688" containerID="1020d6462183f08b94ced157faa61664df8ad51dc9183a84c7103ee7b7e739a4" exitCode=0
Oct 30 21:26:39.126602 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.126581    5575 generic.go:356] "Generic (PLEG): container finished" podID="905463aa-ad39-43cf-8816-19891550eae5" containerID="425e362228dbd2a9ca78738216e374b96da29492ab0529706e1f1018c770a8b5" exitCode=0
Oct 30 21:26:39.127914 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.127887    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk" event={"ID":"f9702ac2-3b8f-427d-8d11-59803ff043d0","Type":"ContainerDied","Data":"ec72b5c4df2421e2bc47543c74a0e24661a713986da3b49269d2d5177b413c71"}
Oct 30 21:26:39.128037 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.127935    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg" event={"ID":"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf","Type":"ContainerDied","Data":"bcaba65ccf496f3ee624c2c52ba0d4f1cce786b5cf92d206a1c2d5df80ca970f"}
Oct 30 21:26:39.128037 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.127958    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8" event={"ID":"60d92dcf-f112-4dba-baeb-038fa2571688","Type":"ContainerDied","Data":"1020d6462183f08b94ced157faa61664df8ad51dc9183a84c7103ee7b7e739a4"}
Oct 30 21:26:39.128037 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.128000    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r" event={"ID":"905463aa-ad39-43cf-8816-19891550eae5","Type":"ContainerDied","Data":"425e362228dbd2a9ca78738216e374b96da29492ab0529706e1f1018c770a8b5"}
Oct 30 21:26:39.129150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.129111    5575 generic.go:356] "Generic (PLEG): container finished" podID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerID="63d3f45bea45ae5b4d1a567bbd7df7d62710a843b9e99bc63272f158977bdbaa" exitCode=0
Oct 30 21:26:39.129240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.129195    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c" event={"ID":"fe516e24-69ef-41c6-8725-2f515de71b8b","Type":"ContainerDied","Data":"63d3f45bea45ae5b4d1a567bbd7df7d62710a843b9e99bc63272f158977bdbaa"}
Oct 30 21:26:39.130900 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.130880    5575 generic.go:356] "Generic (PLEG): container finished" podID="fbadad89-60da-48ae-8c21-2f6d859be832" containerID="172369eeebe53163c70f6024082fa31ca61bf76442c33bf7538f402441fecb12" exitCode=0
Oct 30 21:26:39.131396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.131365    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft" event={"ID":"fbadad89-60da-48ae-8c21-2f6d859be832","Type":"ContainerDied","Data":"172369eeebe53163c70f6024082fa31ca61bf76442c33bf7538f402441fecb12"}
Oct 30 21:26:39.132639 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.132609    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:26:39.133227 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:39.133206    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc"
Oct 30 21:26:40.139877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:40.139843    5575 generic.go:356] "Generic (PLEG): container finished" podID="5352e843-2833-4330-8e32-2055b23944b0" containerID="89da96021668792c5fb976993243344479e23d3f32d0cf5321bd4acbe2fa2bf8" exitCode=0
Oct 30 21:26:40.140409 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:40.139937    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x" event={"ID":"5352e843-2833-4330-8e32-2055b23944b0","Type":"ContainerDied","Data":"89da96021668792c5fb976993243344479e23d3f32d0cf5321bd4acbe2fa2bf8"}
Oct 30 21:26:41.149070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.149037    5575 generic.go:356] "Generic (PLEG): container finished" podID="28107625-e680-4391-a6d7-247d1ea92918" containerID="fd35d32bef5752d91bbaea65324a3bd56746becec77dc09e4cb7439194540a17" exitCode=0
Oct 30 21:26:41.149533 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.149417    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9" event={"ID":"28107625-e680-4391-a6d7-247d1ea92918","Type":"ContainerDied","Data":"fd35d32bef5752d91bbaea65324a3bd56746becec77dc09e4cb7439194540a17"}
Oct 30 21:26:41.151812 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.151785    5575 generic.go:356] "Generic (PLEG): container finished" podID="6c04fe71-28c8-411f-85af-e352900a218e" containerID="0f86226f6fe1ff41d49d79356ebeecfc8b66a150bd51bfe9bfd34382dc63b5b8" exitCode=0
Oct 30 21:26:41.152084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.152063    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch" event={"ID":"6c04fe71-28c8-411f-85af-e352900a218e","Type":"ContainerDied","Data":"0f86226f6fe1ff41d49d79356ebeecfc8b66a150bd51bfe9bfd34382dc63b5b8"}
Oct 30 21:26:41.158687 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.158663    5575 generic.go:356] "Generic (PLEG): container finished" podID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerID="2c4cf0a9597753ad641596feefc8e6414f49d1229623acac4401297c5bea9993" exitCode=0
Oct 30 21:26:41.158776 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.158747    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg" event={"ID":"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf","Type":"ContainerDied","Data":"2c4cf0a9597753ad641596feefc8e6414f49d1229623acac4401297c5bea9993"}
Oct 30 21:26:41.162266 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.162216    5575 generic.go:356] "Generic (PLEG): container finished" podID="60d92dcf-f112-4dba-baeb-038fa2571688" containerID="c341f9dcfdc8e39c2bc41eaf247ecff3f335229b84f8e014d4c1b3607040eee9" exitCode=0
Oct 30 21:26:41.162353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.162280    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8" event={"ID":"60d92dcf-f112-4dba-baeb-038fa2571688","Type":"ContainerDied","Data":"c341f9dcfdc8e39c2bc41eaf247ecff3f335229b84f8e014d4c1b3607040eee9"}
Oct 30 21:26:41.168099 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.167640    5575 generic.go:356] "Generic (PLEG): container finished" podID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerID="3674708196eb9006308264a628cbc1c44d4fb28dd985d15b2004bfdc04c4bd74" exitCode=0
Oct 30 21:26:41.168099 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.168035    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c" event={"ID":"fe516e24-69ef-41c6-8725-2f515de71b8b","Type":"ContainerDied","Data":"3674708196eb9006308264a628cbc1c44d4fb28dd985d15b2004bfdc04c4bd74"}
Oct 30 21:26:41.359516 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:41.358959    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:42.178596 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:42.177600    5575 generic.go:356] "Generic (PLEG): container finished" podID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerID="8e596e0ae23c1c9d768b1c83f386cd1c53beea6bcdc9303f9a8437e2ff3c2b20" exitCode=0
Oct 30 21:26:42.178596 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:42.177752    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r" event={"ID":"50a0052b-8480-486c-ac55-b5fbb7fa0139","Type":"ContainerDied","Data":"8e596e0ae23c1c9d768b1c83f386cd1c53beea6bcdc9303f9a8437e2ff3c2b20"}
Oct 30 21:26:42.184324 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:42.184298    5575 generic.go:356] "Generic (PLEG): container finished" podID="5352e843-2833-4330-8e32-2055b23944b0" containerID="a8e7ab5e645ddf50f9bc638dfb0866f43330015737ba8652f68e34649b268fb8" exitCode=0
Oct 30 21:26:42.184420 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:42.184381    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x" event={"ID":"5352e843-2833-4330-8e32-2055b23944b0","Type":"ContainerDied","Data":"a8e7ab5e645ddf50f9bc638dfb0866f43330015737ba8652f68e34649b268fb8"}
Oct 30 21:26:42.188525 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:42.188492    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf" event={"ID":"5fce63a6-0602-4a22-90ab-8e2fbe809cab","Type":"ContainerStarted","Data":"08f0b48678b7c633829e0ebd913ab9b642cdc8663b9aa99d99ec1d08730690cb"}
Oct 30 21:26:42.191801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:42.191780    5575 generic.go:356] "Generic (PLEG): container finished" podID="905463aa-ad39-43cf-8816-19891550eae5" containerID="d24b85ae69d09a1bdd78706cba347d2fcbe4d44c6e4a35ca6591df10c68b7dbd" exitCode=0
Oct 30 21:26:42.191903 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:42.191857    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r" event={"ID":"905463aa-ad39-43cf-8816-19891550eae5","Type":"ContainerDied","Data":"d24b85ae69d09a1bdd78706cba347d2fcbe4d44c6e4a35ca6591df10c68b7dbd"}
Oct 30 21:26:42.195925 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:42.195402    5575 generic.go:356] "Generic (PLEG): container finished" podID="fbadad89-60da-48ae-8c21-2f6d859be832" containerID="294787384b659de90f805fb970396ce9d7279d084c5880f82c441e7b8f0293e9" exitCode=0
Oct 30 21:26:42.195925 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:42.195462    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft" event={"ID":"fbadad89-60da-48ae-8c21-2f6d859be832","Type":"ContainerDied","Data":"294787384b659de90f805fb970396ce9d7279d084c5880f82c441e7b8f0293e9"}
Oct 30 21:26:43.206250 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:43.206212    5575 generic.go:356] "Generic (PLEG): container finished" podID="6c04fe71-28c8-411f-85af-e352900a218e" containerID="1559e1097291e0aa0432fcc228cac806d346a08e406d4bd33bc3f6e81b2dddac" exitCode=0
Oct 30 21:26:43.206812 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:43.206396    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch" event={"ID":"6c04fe71-28c8-411f-85af-e352900a218e","Type":"ContainerDied","Data":"1559e1097291e0aa0432fcc228cac806d346a08e406d4bd33bc3f6e81b2dddac"}
Oct 30 21:26:43.214977 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:43.214939    5575 generic.go:356] "Generic (PLEG): container finished" podID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerID="08f0b48678b7c633829e0ebd913ab9b642cdc8663b9aa99d99ec1d08730690cb" exitCode=0
Oct 30 21:26:43.215073 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:43.215043    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf" event={"ID":"5fce63a6-0602-4a22-90ab-8e2fbe809cab","Type":"ContainerDied","Data":"08f0b48678b7c633829e0ebd913ab9b642cdc8663b9aa99d99ec1d08730690cb"}
Oct 30 21:26:47.306600 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:47.305305    5575 generic.go:356] "Generic (PLEG): container finished" podID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerID="c895f96f72dda64cbd2a6dc74bb7034f641f09d9b91b42d1817ba606c8fee6f8" exitCode=0
Oct 30 21:26:47.306600 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:26:47.305461    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk" event={"ID":"f9702ac2-3b8f-427d-8d11-59803ff043d0","Type":"ContainerDied","Data":"c895f96f72dda64cbd2a6dc74bb7034f641f09d9b91b42d1817ba606c8fee6f8"}
Oct 30 21:26:53.547360 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:26:53.547141    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:27:03.547684 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:03.547650    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c" event={"ID":"fe516e24-69ef-41c6-8725-2f515de71b8b","Type":"ContainerStarted","Data":"db4b48462a29f493119273f4eb59014c04b284230fc8a3c62c32a531c1247159"}
Oct 30 21:27:03.553222 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:03.552892    5575 generic.go:356] "Generic (PLEG): container finished" podID="28107625-e680-4391-a6d7-247d1ea92918" containerID="2b8bf0fc13a056fffba6b34ce280cf62c76b53ed362b57b99bc6d74b12249cf9" exitCode=0
Oct 30 21:27:03.553222 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:03.553028    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9" event={"ID":"28107625-e680-4391-a6d7-247d1ea92918","Type":"ContainerDied","Data":"2b8bf0fc13a056fffba6b34ce280cf62c76b53ed362b57b99bc6d74b12249cf9"}
Oct 30 21:27:03.693892 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:03.693741    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c" podStartSLOduration=3.562124438 podStartE2EDuration="41.693661029s" totalImagesPullingTime="38.131536591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:03.689596157 +0000 UTC m=+224.721444693" watchObservedRunningTime="2026-10-30 21:27:03.693661029 +0000 UTC m=+224.725509592"
Oct 30 21:27:04.566025 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.565990    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:27:04.567481 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.567440    5575 generic.go:356] "Generic (PLEG): container finished" podID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerID="947873b7ed52d24116ffaec647e3742d54af199a7a9b3eec70503109ba983145" exitCode=1
Oct 30 21:27:04.567597 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.567532    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg" event={"ID":"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf","Type":"ContainerDied","Data":"947873b7ed52d24116ffaec647e3742d54af199a7a9b3eec70503109ba983145"}
Oct 30 21:27:04.572168 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.572140    5575 generic.go:356] "Generic (PLEG): container finished" podID="60d92dcf-f112-4dba-baeb-038fa2571688" containerID="8de0b440977d6cb29baad40ac9393166dc4fd3388e810334275aace3aab20518" exitCode=0
Oct 30 21:27:04.572284 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.572224    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8" event={"ID":"60d92dcf-f112-4dba-baeb-038fa2571688","Type":"ContainerDied","Data":"8de0b440977d6cb29baad40ac9393166dc4fd3388e810334275aace3aab20518"}
Oct 30 21:27:04.576598 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.576576    5575 generic.go:356] "Generic (PLEG): container finished" podID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerID="db4b48462a29f493119273f4eb59014c04b284230fc8a3c62c32a531c1247159" exitCode=0
Oct 30 21:27:04.577089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.577071    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c" event={"ID":"fe516e24-69ef-41c6-8725-2f515de71b8b","Type":"ContainerDied","Data":"db4b48462a29f493119273f4eb59014c04b284230fc8a3c62c32a531c1247159"}
Oct 30 21:27:04.796307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.796270    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:27:04.911514 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.910619    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28107625-e680-4391-a6d7-247d1ea92918-kube-api-access-fksgv\" (UniqueName: \"kubernetes.io/projected/28107625-e680-4391-a6d7-247d1ea92918-kube-api-access-fksgv\") pod \"28107625-e680-4391-a6d7-247d1ea92918\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") "
Oct 30 21:27:04.911514 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.910721    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-util\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-util\") pod \"28107625-e680-4391-a6d7-247d1ea92918\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") "
Oct 30 21:27:04.911514 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.910765    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-bundle\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-bundle\") pod \"28107625-e680-4391-a6d7-247d1ea92918\" (UID: \"28107625-e680-4391-a6d7-247d1ea92918\") "
Oct 30 21:27:04.912662 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.912633    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-bundle" pod "28107625-e680-4391-a6d7-247d1ea92918" (UID: "28107625-e680-4391-a6d7-247d1ea92918"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:04.919248 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.919224    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-util" pod "28107625-e680-4391-a6d7-247d1ea92918" (UID: "28107625-e680-4391-a6d7-247d1ea92918"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:04.919531 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:04.919508    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28107625-e680-4391-a6d7-247d1ea92918-kube-api-access-fksgv" pod "28107625-e680-4391-a6d7-247d1ea92918" (UID: "28107625-e680-4391-a6d7-247d1ea92918"). InnerVolumeSpecName "kube-api-access-fksgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:05.012547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.012473    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fksgv\" (UniqueName: \"kubernetes.io/projected/28107625-e680-4391-a6d7-247d1ea92918-kube-api-access-fksgv\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:05.012547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.012507    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:05.012547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.012523    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28107625-e680-4391-a6d7-247d1ea92918-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:05.588891 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.588860    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft" event={"ID":"fbadad89-60da-48ae-8c21-2f6d859be832","Type":"ContainerStarted","Data":"16541e31bf624e2cfbdf31360b6b647486b863874729e0cbe5ab08f07e88e426"}
Oct 30 21:27:05.591897 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.591865    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9"
Oct 30 21:27:05.591897 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.591877    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahnkh9" event={"ID":"28107625-e680-4391-a6d7-247d1ea92918","Type":"ContainerDied","Data":"61abbaf5af55574149a34ed2538d9bc4a7465ffca2139132680ef7b573e4980b"}
Oct 30 21:27:05.592146 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.591922    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61abbaf5af55574149a34ed2538d9bc4a7465ffca2139132680ef7b573e4980b"
Oct 30 21:27:05.594413 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.594374    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r" event={"ID":"50a0052b-8480-486c-ac55-b5fbb7fa0139","Type":"ContainerStarted","Data":"fae7c076feb2b4fe46c6d388f134bd220c509a2f590c500770f614ea02f54f51"}
Oct 30 21:27:05.710163 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.710086    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft" podStartSLOduration=3.439584571 podStartE2EDuration="43.710064805s" totalImagesPullingTime="40.270480234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:05.708260491 +0000 UTC m=+226.740109027" watchObservedRunningTime="2026-10-30 21:27:05.710064805 +0000 UTC m=+226.741913341"
Oct 30 21:27:05.751583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.751556    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:27:05.824340 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.824313    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:27:05.826685 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.826659    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-util\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-util\") pod \"60d92dcf-f112-4dba-baeb-038fa2571688\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") "
Oct 30 21:27:05.826825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.826727    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-bundle\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-bundle\") pod \"60d92dcf-f112-4dba-baeb-038fa2571688\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") "
Oct 30 21:27:05.826825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.826793    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60d92dcf-f112-4dba-baeb-038fa2571688-kube-api-access-n8rjs\" (UniqueName: \"kubernetes.io/projected/60d92dcf-f112-4dba-baeb-038fa2571688-kube-api-access-n8rjs\") pod \"60d92dcf-f112-4dba-baeb-038fa2571688\" (UID: \"60d92dcf-f112-4dba-baeb-038fa2571688\") "
Oct 30 21:27:05.828490 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.828235    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r" podStartSLOduration=3.99636494 podStartE2EDuration="43.82745599s" totalImagesPullingTime="39.83109105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:05.826349032 +0000 UTC m=+226.858197570" watchObservedRunningTime="2026-10-30 21:27:05.82745599 +0000 UTC m=+226.859304530"
Oct 30 21:27:05.829301 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.829273    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-bundle" pod "60d92dcf-f112-4dba-baeb-038fa2571688" (UID: "60d92dcf-f112-4dba-baeb-038fa2571688"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:05.831109 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.830725    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d92dcf-f112-4dba-baeb-038fa2571688-kube-api-access-n8rjs" pod "60d92dcf-f112-4dba-baeb-038fa2571688" (UID: "60d92dcf-f112-4dba-baeb-038fa2571688"). InnerVolumeSpecName "kube-api-access-n8rjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:05.835259 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.835231    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-util" pod "60d92dcf-f112-4dba-baeb-038fa2571688" (UID: "60d92dcf-f112-4dba-baeb-038fa2571688"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:05.855708 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.855690    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:27:05.871385 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.871294    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:27:05.927768 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.927745    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-util\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-util\") pod \"fe516e24-69ef-41c6-8725-2f515de71b8b\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") "
Oct 30 21:27:05.927876 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.927794    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-util\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-util\") pod \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") "
Oct 30 21:27:05.927876 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.927833    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe516e24-69ef-41c6-8725-2f515de71b8b-kube-api-access-5kgjd\" (UniqueName: \"kubernetes.io/projected/fe516e24-69ef-41c6-8725-2f515de71b8b-kube-api-access-5kgjd\") pod \"fe516e24-69ef-41c6-8725-2f515de71b8b\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") "
Oct 30 21:27:05.927876 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.927861    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-kube-api-access-bx7nh\" (UniqueName: \"kubernetes.io/projected/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-kube-api-access-bx7nh\") pod \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") "
Oct 30 21:27:05.929140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.927887    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-bundle\") pod \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\" (UID: \"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf\") "
Oct 30 21:27:05.929140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.927937    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-bundle\") pod \"fe516e24-69ef-41c6-8725-2f515de71b8b\" (UID: \"fe516e24-69ef-41c6-8725-2f515de71b8b\") "
Oct 30 21:27:05.929140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.928638    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:05.929140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.928661    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60d92dcf-f112-4dba-baeb-038fa2571688-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:05.929140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.928673    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8rjs\" (UniqueName: \"kubernetes.io/projected/60d92dcf-f112-4dba-baeb-038fa2571688-kube-api-access-n8rjs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:05.929140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.928927    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-bundle" pod "08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" (UID: "08c4cbb4-61e1-4aea-aa1c-4c7295592aaf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:05.929609 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.929560    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-bundle" pod "fe516e24-69ef-41c6-8725-2f515de71b8b" (UID: "fe516e24-69ef-41c6-8725-2f515de71b8b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:05.936353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.936243    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-kube-api-access-bx7nh" pod "08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" (UID: "08c4cbb4-61e1-4aea-aa1c-4c7295592aaf"). InnerVolumeSpecName "kube-api-access-bx7nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:05.936353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.936316    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe516e24-69ef-41c6-8725-2f515de71b8b-kube-api-access-5kgjd" pod "fe516e24-69ef-41c6-8725-2f515de71b8b" (UID: "fe516e24-69ef-41c6-8725-2f515de71b8b"). InnerVolumeSpecName "kube-api-access-5kgjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:05.936800 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.936771    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-util" pod "08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" (UID: "08c4cbb4-61e1-4aea-aa1c-4c7295592aaf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:05.941465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:05.941430    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-util" pod "fe516e24-69ef-41c6-8725-2f515de71b8b" (UID: "fe516e24-69ef-41c6-8725-2f515de71b8b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:06.030251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.030137    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:06.030251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.030168    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:06.030251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.030183    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kgjd\" (UniqueName: \"kubernetes.io/projected/fe516e24-69ef-41c6-8725-2f515de71b8b-kube-api-access-5kgjd\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:06.030251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.030200    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx7nh\" (UniqueName: \"kubernetes.io/projected/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-kube-api-access-bx7nh\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:06.030251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.030215    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c4cbb4-61e1-4aea-aa1c-4c7295592aaf-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:06.030251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.030230    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe516e24-69ef-41c6-8725-2f515de71b8b-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:06.602611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.602512    5575 generic.go:356] "Generic (PLEG): container finished" podID="5352e843-2833-4330-8e32-2055b23944b0" containerID="320650e95e29eaeaf2305fb36229b89d955756b6401d4c3dfd25d6ce25e32c6a" exitCode=0
Oct 30 21:27:06.602611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.602571    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x" event={"ID":"5352e843-2833-4330-8e32-2055b23944b0","Type":"ContainerDied","Data":"320650e95e29eaeaf2305fb36229b89d955756b6401d4c3dfd25d6ce25e32c6a"}
Oct 30 21:27:06.605142 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.605113    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf" event={"ID":"5fce63a6-0602-4a22-90ab-8e2fbe809cab","Type":"ContainerStarted","Data":"a47411749bffc29654add0a0ba2cd42ec246d0ea75477acea601a5ad195e5399"}
Oct 30 21:27:06.606485 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.606467    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:27:06.607262 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.607241    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg" event={"ID":"08c4cbb4-61e1-4aea-aa1c-4c7295592aaf","Type":"ContainerDied","Data":"b0eecfbf32e690e27254f51081cc40c2bc19b14328610efa18783d8d469fbf96"}
Oct 30 21:27:06.607367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.607279    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0eecfbf32e690e27254f51081cc40c2bc19b14328610efa18783d8d469fbf96"
Oct 30 21:27:06.607367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.607248    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg"
Oct 30 21:27:06.609464 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.609441    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8" event={"ID":"60d92dcf-f112-4dba-baeb-038fa2571688","Type":"ContainerDied","Data":"2c9ebcb09ca2afa60758e10efa608ae5e5cee4fdf31190b9cf939f0da587fd87"}
Oct 30 21:27:06.609464 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.609458    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmlph8"
Oct 30 21:27:06.609623 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.609478    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c9ebcb09ca2afa60758e10efa608ae5e5cee4fdf31190b9cf939f0da587fd87"
Oct 30 21:27:06.613287 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.613260    5575 generic.go:356] "Generic (PLEG): container finished" podID="905463aa-ad39-43cf-8816-19891550eae5" containerID="2d21485c6621f4986721b4941a4d6491f1178e889aec5a9c50fa1121896f7dc2" exitCode=0
Oct 30 21:27:06.613404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.613345    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r" event={"ID":"905463aa-ad39-43cf-8816-19891550eae5","Type":"ContainerDied","Data":"2d21485c6621f4986721b4941a4d6491f1178e889aec5a9c50fa1121896f7dc2"}
Oct 30 21:27:06.619229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.619199    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c" event={"ID":"fe516e24-69ef-41c6-8725-2f515de71b8b","Type":"ContainerDied","Data":"63b8b6b0bec9d5ed556adf39f11eaf6282035544c9f64aab7ba02c18be051d39"}
Oct 30 21:27:06.619229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.619226    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8zq8c"
Oct 30 21:27:06.619353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.619235    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63b8b6b0bec9d5ed556adf39f11eaf6282035544c9f64aab7ba02c18be051d39"
Oct 30 21:27:06.622062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.622038    5575 generic.go:356] "Generic (PLEG): container finished" podID="fbadad89-60da-48ae-8c21-2f6d859be832" containerID="16541e31bf624e2cfbdf31360b6b647486b863874729e0cbe5ab08f07e88e426" exitCode=0
Oct 30 21:27:06.622158 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.622132    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft" event={"ID":"fbadad89-60da-48ae-8c21-2f6d859be832","Type":"ContainerDied","Data":"16541e31bf624e2cfbdf31360b6b647486b863874729e0cbe5ab08f07e88e426"}
Oct 30 21:27:06.624921 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.624897    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch" event={"ID":"6c04fe71-28c8-411f-85af-e352900a218e","Type":"ContainerStarted","Data":"f22e8deda518b8e93f2b201695dbac4e834cd443378374e928ea85fc82b6142d"}
Oct 30 21:27:06.627529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.627511    5575 generic.go:356] "Generic (PLEG): container finished" podID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerID="fae7c076feb2b4fe46c6d388f134bd220c509a2f590c500770f614ea02f54f51" exitCode=0
Oct 30 21:27:06.627621 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:06.627533    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r" event={"ID":"50a0052b-8480-486c-ac55-b5fbb7fa0139","Type":"ContainerDied","Data":"fae7c076feb2b4fe46c6d388f134bd220c509a2f590c500770f614ea02f54f51"}
Oct 30 21:27:07.133597 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.133546    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch" podStartSLOduration=3.937161004 podStartE2EDuration="47.133531759s" totalImagesPullingTime="43.196370755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:07.133453203 +0000 UTC m=+228.165301772" watchObservedRunningTime="2026-10-30 21:27:07.133531759 +0000 UTC m=+228.165380288"
Oct 30 21:27:07.304232 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.304141    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf" podStartSLOduration=3.015050731 podStartE2EDuration="51.304126737s" totalImagesPullingTime="48.289076006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:07.303568571 +0000 UTC m=+228.335417107" watchObservedRunningTime="2026-10-30 21:27:07.304126737 +0000 UTC m=+228.335975312"
Oct 30 21:27:07.634778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.634746    5575 generic.go:356] "Generic (PLEG): container finished" podID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerID="cb2c36ef8ab57b6feff2cace4b373af8b59117924c4c307f1f4b162138e287b9" exitCode=0
Oct 30 21:27:07.635170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.634782    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk" event={"ID":"f9702ac2-3b8f-427d-8d11-59803ff043d0","Type":"ContainerDied","Data":"cb2c36ef8ab57b6feff2cace4b373af8b59117924c4c307f1f4b162138e287b9"}
Oct 30 21:27:07.636991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.636950    5575 generic.go:356] "Generic (PLEG): container finished" podID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerID="a47411749bffc29654add0a0ba2cd42ec246d0ea75477acea601a5ad195e5399" exitCode=0
Oct 30 21:27:07.637078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.636995    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf" event={"ID":"5fce63a6-0602-4a22-90ab-8e2fbe809cab","Type":"ContainerDied","Data":"a47411749bffc29654add0a0ba2cd42ec246d0ea75477acea601a5ad195e5399"}
Oct 30 21:27:07.639297 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.639184    5575 generic.go:356] "Generic (PLEG): container finished" podID="6c04fe71-28c8-411f-85af-e352900a218e" containerID="f22e8deda518b8e93f2b201695dbac4e834cd443378374e928ea85fc82b6142d" exitCode=0
Oct 30 21:27:07.639297 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.639272    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch" event={"ID":"6c04fe71-28c8-411f-85af-e352900a218e","Type":"ContainerDied","Data":"f22e8deda518b8e93f2b201695dbac4e834cd443378374e928ea85fc82b6142d"}
Oct 30 21:27:07.773631 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.773606    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:27:07.822499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.822475    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:27:07.826335 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.826314    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:27:07.845721 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.845703    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50a0052b-8480-486c-ac55-b5fbb7fa0139-kube-api-access-zhbz5\" (UniqueName: \"kubernetes.io/projected/50a0052b-8480-486c-ac55-b5fbb7fa0139-kube-api-access-zhbz5\") pod \"50a0052b-8480-486c-ac55-b5fbb7fa0139\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") "
Oct 30 21:27:07.845824 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.845783    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-util\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-util\") pod \"50a0052b-8480-486c-ac55-b5fbb7fa0139\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") "
Oct 30 21:27:07.845824 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.845808    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-bundle\") pod \"50a0052b-8480-486c-ac55-b5fbb7fa0139\" (UID: \"50a0052b-8480-486c-ac55-b5fbb7fa0139\") "
Oct 30 21:27:07.846279 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.846255    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-bundle" pod "50a0052b-8480-486c-ac55-b5fbb7fa0139" (UID: "50a0052b-8480-486c-ac55-b5fbb7fa0139"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.847928 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.847905    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50a0052b-8480-486c-ac55-b5fbb7fa0139-kube-api-access-zhbz5" pod "50a0052b-8480-486c-ac55-b5fbb7fa0139" (UID: "50a0052b-8480-486c-ac55-b5fbb7fa0139"). InnerVolumeSpecName "kube-api-access-zhbz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:07.850326 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.850306    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:27:07.853449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.853422    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-util" pod "50a0052b-8480-486c-ac55-b5fbb7fa0139" (UID: "50a0052b-8480-486c-ac55-b5fbb7fa0139"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.946641 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.946585    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbadad89-60da-48ae-8c21-2f6d859be832-kube-api-access-lv2kg\" (UniqueName: \"kubernetes.io/projected/fbadad89-60da-48ae-8c21-2f6d859be832-kube-api-access-lv2kg\") pod \"fbadad89-60da-48ae-8c21-2f6d859be832\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") "
Oct 30 21:27:07.946739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.946648    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-bundle\") pod \"905463aa-ad39-43cf-8816-19891550eae5\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") "
Oct 30 21:27:07.946739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.946680    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/905463aa-ad39-43cf-8816-19891550eae5-kube-api-access-qs4g5\" (UniqueName: \"kubernetes.io/projected/905463aa-ad39-43cf-8816-19891550eae5-kube-api-access-qs4g5\") pod \"905463aa-ad39-43cf-8816-19891550eae5\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") "
Oct 30 21:27:07.946739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.946710    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-bundle\") pod \"fbadad89-60da-48ae-8c21-2f6d859be832\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") "
Oct 30 21:27:07.946739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.946729    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5352e843-2833-4330-8e32-2055b23944b0-kube-api-access-qnfq5\" (UniqueName: \"kubernetes.io/projected/5352e843-2833-4330-8e32-2055b23944b0-kube-api-access-qnfq5\") pod \"5352e843-2833-4330-8e32-2055b23944b0\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") "
Oct 30 21:27:07.946952 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.946747    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-util\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-util\") pod \"fbadad89-60da-48ae-8c21-2f6d859be832\" (UID: \"fbadad89-60da-48ae-8c21-2f6d859be832\") "
Oct 30 21:27:07.946952 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.946801    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-util\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-util\") pod \"905463aa-ad39-43cf-8816-19891550eae5\" (UID: \"905463aa-ad39-43cf-8816-19891550eae5\") "
Oct 30 21:27:07.946952 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.946852    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-util\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-util\") pod \"5352e843-2833-4330-8e32-2055b23944b0\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") "
Oct 30 21:27:07.946952 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.946877    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-bundle\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-bundle\") pod \"5352e843-2833-4330-8e32-2055b23944b0\" (UID: \"5352e843-2833-4330-8e32-2055b23944b0\") "
Oct 30 21:27:07.947191 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.947147    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.947191 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.947166    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a0052b-8480-486c-ac55-b5fbb7fa0139-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.947191 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.947180    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhbz5\" (UniqueName: \"kubernetes.io/projected/50a0052b-8480-486c-ac55-b5fbb7fa0139-kube-api-access-zhbz5\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.947340 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.947227    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-bundle" pod "fbadad89-60da-48ae-8c21-2f6d859be832" (UID: "fbadad89-60da-48ae-8c21-2f6d859be832"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.947881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.947856    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-bundle" pod "5352e843-2833-4330-8e32-2055b23944b0" (UID: "5352e843-2833-4330-8e32-2055b23944b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.948185 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.948164    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-bundle" pod "905463aa-ad39-43cf-8816-19891550eae5" (UID: "905463aa-ad39-43cf-8816-19891550eae5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.949207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.949189    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5352e843-2833-4330-8e32-2055b23944b0-kube-api-access-qnfq5" pod "5352e843-2833-4330-8e32-2055b23944b0" (UID: "5352e843-2833-4330-8e32-2055b23944b0"). InnerVolumeSpecName "kube-api-access-qnfq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:07.949350 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.949334    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905463aa-ad39-43cf-8816-19891550eae5-kube-api-access-qs4g5" pod "905463aa-ad39-43cf-8816-19891550eae5" (UID: "905463aa-ad39-43cf-8816-19891550eae5"). InnerVolumeSpecName "kube-api-access-qs4g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:07.949404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.949353    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbadad89-60da-48ae-8c21-2f6d859be832-kube-api-access-lv2kg" pod "fbadad89-60da-48ae-8c21-2f6d859be832" (UID: "fbadad89-60da-48ae-8c21-2f6d859be832"). InnerVolumeSpecName "kube-api-access-lv2kg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:07.955538 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.955516    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-util" pod "5352e843-2833-4330-8e32-2055b23944b0" (UID: "5352e843-2833-4330-8e32-2055b23944b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.955770 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.955749    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-util" pod "fbadad89-60da-48ae-8c21-2f6d859be832" (UID: "fbadad89-60da-48ae-8c21-2f6d859be832"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.955878 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:07.955858    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-util" pod "905463aa-ad39-43cf-8816-19891550eae5" (UID: "905463aa-ad39-43cf-8816-19891550eae5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:08.047834 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.047807    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.047834 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.047833    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs4g5\" (UniqueName: \"kubernetes.io/projected/905463aa-ad39-43cf-8816-19891550eae5-kube-api-access-qs4g5\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.047999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.047850    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.047999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.047862    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnfq5\" (UniqueName: \"kubernetes.io/projected/5352e843-2833-4330-8e32-2055b23944b0-kube-api-access-qnfq5\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.047999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.047876    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbadad89-60da-48ae-8c21-2f6d859be832-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.047999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.047889    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905463aa-ad39-43cf-8816-19891550eae5-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.047999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.047902    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.047999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.047914    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5352e843-2833-4330-8e32-2055b23944b0-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.047999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.047926    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv2kg\" (UniqueName: \"kubernetes.io/projected/fbadad89-60da-48ae-8c21-2f6d859be832-kube-api-access-lv2kg\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.646122 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.646093    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x"
Oct 30 21:27:08.646532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.646090    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ttk6x" event={"ID":"5352e843-2833-4330-8e32-2055b23944b0","Type":"ContainerDied","Data":"e050bd76a5a908ee0c837dc5b952a0eb9fd71d6c314ebaf6c4436d779df42270"}
Oct 30 21:27:08.646532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.646221    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e050bd76a5a908ee0c837dc5b952a0eb9fd71d6c314ebaf6c4436d779df42270"
Oct 30 21:27:08.648021 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.648001    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r"
Oct 30 21:27:08.648153 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.647996    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pr57r" event={"ID":"905463aa-ad39-43cf-8816-19891550eae5","Type":"ContainerDied","Data":"97b757b59ed1cd657dd09b185bfbccda14be452a6591d87ea7e07450c3c3e36f"}
Oct 30 21:27:08.648153 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.648128    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97b757b59ed1cd657dd09b185bfbccda14be452a6591d87ea7e07450c3c3e36f"
Oct 30 21:27:08.650033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.650017    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft"
Oct 30 21:27:08.650140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.650061    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68r7ft" event={"ID":"fbadad89-60da-48ae-8c21-2f6d859be832","Type":"ContainerDied","Data":"884aa748b63484a001d7be376c809b1a515fceed9fe7fdc9521090efbe0c080b"}
Oct 30 21:27:08.650140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.650096    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="884aa748b63484a001d7be376c809b1a515fceed9fe7fdc9521090efbe0c080b"
Oct 30 21:27:08.652299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.652251    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r" event={"ID":"50a0052b-8480-486c-ac55-b5fbb7fa0139","Type":"ContainerDied","Data":"970657788b47ad7bc60dd6b61bd971560dd8f732729e2a6bf989a9b5a616de40"}
Oct 30 21:27:08.652299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.652273    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7rpl4r"
Oct 30 21:27:08.652299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.652294    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="970657788b47ad7bc60dd6b61bd971560dd8f732729e2a6bf989a9b5a616de40"
Oct 30 21:27:08.814677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.814652    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:27:08.816920 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.816902    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:27:08.839433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.839409    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:27:08.964277 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964204    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-bundle\") pod \"f9702ac2-3b8f-427d-8d11-59803ff043d0\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") "
Oct 30 21:27:08.964277 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964242    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-bundle\") pod \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") "
Oct 30 21:27:08.964277 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964275    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-util\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-util\") pod \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") "
Oct 30 21:27:08.964538 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964344    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-util\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-util\") pod \"6c04fe71-28c8-411f-85af-e352900a218e\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") "
Oct 30 21:27:08.964538 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964373    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9702ac2-3b8f-427d-8d11-59803ff043d0-kube-api-access-dx2mf\" (UniqueName: \"kubernetes.io/projected/f9702ac2-3b8f-427d-8d11-59803ff043d0-kube-api-access-dx2mf\") pod \"f9702ac2-3b8f-427d-8d11-59803ff043d0\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") "
Oct 30 21:27:08.964538 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964398    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-util\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-util\") pod \"f9702ac2-3b8f-427d-8d11-59803ff043d0\" (UID: \"f9702ac2-3b8f-427d-8d11-59803ff043d0\") "
Oct 30 21:27:08.964538 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964429    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5fce63a6-0602-4a22-90ab-8e2fbe809cab-kube-api-access-h9xd5\" (UniqueName: \"kubernetes.io/projected/5fce63a6-0602-4a22-90ab-8e2fbe809cab-kube-api-access-h9xd5\") pod \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\" (UID: \"5fce63a6-0602-4a22-90ab-8e2fbe809cab\") "
Oct 30 21:27:08.964538 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964460    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-bundle\") pod \"6c04fe71-28c8-411f-85af-e352900a218e\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") "
Oct 30 21:27:08.964538 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964489    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c04fe71-28c8-411f-85af-e352900a218e-kube-api-access-v8t2l\" (UniqueName: \"kubernetes.io/projected/6c04fe71-28c8-411f-85af-e352900a218e-kube-api-access-v8t2l\") pod \"6c04fe71-28c8-411f-85af-e352900a218e\" (UID: \"6c04fe71-28c8-411f-85af-e352900a218e\") "
Oct 30 21:27:08.964820 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964706    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-bundle" pod "f9702ac2-3b8f-427d-8d11-59803ff043d0" (UID: "f9702ac2-3b8f-427d-8d11-59803ff043d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:08.964881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.964826    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:08.965590 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.965553    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-bundle" pod "5fce63a6-0602-4a22-90ab-8e2fbe809cab" (UID: "5fce63a6-0602-4a22-90ab-8e2fbe809cab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:08.965590 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.965569    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-bundle" pod "6c04fe71-28c8-411f-85af-e352900a218e" (UID: "6c04fe71-28c8-411f-85af-e352900a218e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:08.966807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.966780    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9702ac2-3b8f-427d-8d11-59803ff043d0-kube-api-access-dx2mf" pod "f9702ac2-3b8f-427d-8d11-59803ff043d0" (UID: "f9702ac2-3b8f-427d-8d11-59803ff043d0"). InnerVolumeSpecName "kube-api-access-dx2mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:08.966889 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.966834    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c04fe71-28c8-411f-85af-e352900a218e-kube-api-access-v8t2l" pod "6c04fe71-28c8-411f-85af-e352900a218e" (UID: "6c04fe71-28c8-411f-85af-e352900a218e"). InnerVolumeSpecName "kube-api-access-v8t2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:08.967957 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.967936    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fce63a6-0602-4a22-90ab-8e2fbe809cab-kube-api-access-h9xd5" pod "5fce63a6-0602-4a22-90ab-8e2fbe809cab" (UID: "5fce63a6-0602-4a22-90ab-8e2fbe809cab"). InnerVolumeSpecName "kube-api-access-h9xd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:08.972408 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.972385    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-util" pod "6c04fe71-28c8-411f-85af-e352900a218e" (UID: "6c04fe71-28c8-411f-85af-e352900a218e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:08.973588 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.973567    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-util" pod "5fce63a6-0602-4a22-90ab-8e2fbe809cab" (UID: "5fce63a6-0602-4a22-90ab-8e2fbe809cab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:08.973696 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:08.973679    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-util" pod "f9702ac2-3b8f-427d-8d11-59803ff043d0" (UID: "f9702ac2-3b8f-427d-8d11-59803ff043d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:09.065373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.065350    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.065373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.065370    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.065512 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.065381    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx2mf\" (UniqueName: \"kubernetes.io/projected/f9702ac2-3b8f-427d-8d11-59803ff043d0-kube-api-access-dx2mf\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.065512 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.065390    5575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9702ac2-3b8f-427d-8d11-59803ff043d0-util\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.065512 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.065399    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9xd5\" (UniqueName: \"kubernetes.io/projected/5fce63a6-0602-4a22-90ab-8e2fbe809cab-kube-api-access-h9xd5\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.065512 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.065406    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c04fe71-28c8-411f-85af-e352900a218e-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.065512 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.065416    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8t2l\" (UniqueName: \"kubernetes.io/projected/6c04fe71-28c8-411f-85af-e352900a218e-kube-api-access-v8t2l\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.065512 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.065424    5575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fce63a6-0602-4a22-90ab-8e2fbe809cab-bundle\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.659036 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.659007    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf"
Oct 30 21:27:09.659036 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.659022    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cb9sbf" event={"ID":"5fce63a6-0602-4a22-90ab-8e2fbe809cab","Type":"ContainerDied","Data":"6f9cb24203c8f072d46ada638775890c37711eb4e7cefc6faeaf7f0d998547a8"}
Oct 30 21:27:09.659453 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.659074    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f9cb24203c8f072d46ada638775890c37711eb4e7cefc6faeaf7f0d998547a8"
Oct 30 21:27:09.661129 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.661106    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch"
Oct 30 21:27:09.661281 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.661110    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fkgch" event={"ID":"6c04fe71-28c8-411f-85af-e352900a218e","Type":"ContainerDied","Data":"9dd818cdee8c3656dadaee4af4d82d50a19d29013efe677d69c608ad0592ae18"}
Oct 30 21:27:09.661281 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.661242    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dd818cdee8c3656dadaee4af4d82d50a19d29013efe677d69c608ad0592ae18"
Oct 30 21:27:09.663566 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.663533    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk" event={"ID":"f9702ac2-3b8f-427d-8d11-59803ff043d0","Type":"ContainerDied","Data":"00a253cb4dfa9e4c87c62d6166f88bdce926f63733829d4d17737d7025d39d0b"}
Oct 30 21:27:09.663664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.663573    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00a253cb4dfa9e4c87c62d6166f88bdce926f63733829d4d17737d7025d39d0b"
Oct 30 21:27:09.663664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:09.663538    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445svdk"
Oct 30 21:27:13.721406 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:13.721371    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:16.729795 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.729764    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"]
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730060    5575 cpu_manager.go:414] "containerMap: removing container" podUID="905463aa-ad39-43cf-8816-19891550eae5" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730071    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="905463aa-ad39-43cf-8816-19891550eae5" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730079    5575 cpu_manager.go:414] "containerMap: removing container" podUID="5352e843-2833-4330-8e32-2055b23944b0" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730084    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5352e843-2833-4330-8e32-2055b23944b0" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730092    5575 cpu_manager.go:414] "containerMap: removing container" podUID="6c04fe71-28c8-411f-85af-e352900a218e" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730096    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c04fe71-28c8-411f-85af-e352900a218e" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730102    5575 cpu_manager.go:414] "containerMap: removing container" podUID="28107625-e680-4391-a6d7-247d1ea92918" containerName="extract"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730106    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28107625-e680-4391-a6d7-247d1ea92918" containerName="extract"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730119    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fbadad89-60da-48ae-8c21-2f6d859be832" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730123    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbadad89-60da-48ae-8c21-2f6d859be832" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730129    5575 cpu_manager.go:414] "containerMap: removing container" podUID="6c04fe71-28c8-411f-85af-e352900a218e" containerName="extract"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730133    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c04fe71-28c8-411f-85af-e352900a218e" containerName="extract"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730141    5575 cpu_manager.go:414] "containerMap: removing container" podUID="28107625-e680-4391-a6d7-247d1ea92918" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730146    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28107625-e680-4391-a6d7-247d1ea92918" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730152    5575 cpu_manager.go:414] "containerMap: removing container" podUID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730156    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730161    5575 cpu_manager.go:414] "containerMap: removing container" podUID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerName="extract"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730167    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerName="extract"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730176    5575 cpu_manager.go:414] "containerMap: removing container" podUID="905463aa-ad39-43cf-8816-19891550eae5" containerName="util"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730181    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="905463aa-ad39-43cf-8816-19891550eae5" containerName="util"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730188    5575 cpu_manager.go:414] "containerMap: removing container" podUID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerName="util"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730191    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerName="util"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730196    5575 cpu_manager.go:414] "containerMap: removing container" podUID="5352e843-2833-4330-8e32-2055b23944b0" containerName="util"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730200    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5352e843-2833-4330-8e32-2055b23944b0" containerName="util"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730206    5575 cpu_manager.go:414] "containerMap: removing container" podUID="6c04fe71-28c8-411f-85af-e352900a218e" containerName="util"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730211    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c04fe71-28c8-411f-85af-e352900a218e" containerName="util"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730218    5575 cpu_manager.go:414] "containerMap: removing container" podUID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730223    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730228    5575 cpu_manager.go:414] "containerMap: removing container" podUID="60d92dcf-f112-4dba-baeb-038fa2571688" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730232    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60d92dcf-f112-4dba-baeb-038fa2571688" containerName="pull"
Oct 30 21:27:16.730219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730237    5575 cpu_manager.go:414] "containerMap: removing container" podUID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730241    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730248    5575 cpu_manager.go:414] "containerMap: removing container" podUID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730252    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730258    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fbadad89-60da-48ae-8c21-2f6d859be832" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730262    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbadad89-60da-48ae-8c21-2f6d859be832" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730267    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fbadad89-60da-48ae-8c21-2f6d859be832" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730271    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbadad89-60da-48ae-8c21-2f6d859be832" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730277    5575 cpu_manager.go:414] "containerMap: removing container" podUID="5352e843-2833-4330-8e32-2055b23944b0" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730281    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5352e843-2833-4330-8e32-2055b23944b0" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730286    5575 cpu_manager.go:414] "containerMap: removing container" podUID="905463aa-ad39-43cf-8816-19891550eae5" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730289    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="905463aa-ad39-43cf-8816-19891550eae5" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730294    5575 cpu_manager.go:414] "containerMap: removing container" podUID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730298    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730305    5575 cpu_manager.go:414] "containerMap: removing container" podUID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerName="pull"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730308    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerName="pull"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730314    5575 cpu_manager.go:414] "containerMap: removing container" podUID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730318    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730326    5575 cpu_manager.go:414] "containerMap: removing container" podUID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730330    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730336    5575 cpu_manager.go:414] "containerMap: removing container" podUID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerName="pull"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730339    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerName="pull"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730344    5575 cpu_manager.go:414] "containerMap: removing container" podUID="60d92dcf-f112-4dba-baeb-038fa2571688" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730348    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60d92dcf-f112-4dba-baeb-038fa2571688" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730356    5575 cpu_manager.go:414] "containerMap: removing container" podUID="28107625-e680-4391-a6d7-247d1ea92918" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730360    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28107625-e680-4391-a6d7-247d1ea92918" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730365    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerName="pull"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730369    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerName="pull"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730375    5575 cpu_manager.go:414] "containerMap: removing container" podUID="60d92dcf-f112-4dba-baeb-038fa2571688" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730379    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60d92dcf-f112-4dba-baeb-038fa2571688" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730385    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730390    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730395    5575 cpu_manager.go:414] "containerMap: removing container" podUID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730399    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730407    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730412    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerName="util"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730456    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe516e24-69ef-41c6-8725-2f515de71b8b" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730462    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="50a0052b-8480-486c-ac55-b5fbb7fa0139" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730469    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="28107625-e680-4391-a6d7-247d1ea92918" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730475    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c04fe71-28c8-411f-85af-e352900a218e" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730480    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9702ac2-3b8f-427d-8d11-59803ff043d0" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730486    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="08c4cbb4-61e1-4aea-aa1c-4c7295592aaf" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730491    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="fbadad89-60da-48ae-8c21-2f6d859be832" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730495    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="905463aa-ad39-43cf-8816-19891550eae5" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730500    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="5352e843-2833-4330-8e32-2055b23944b0" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730506    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fce63a6-0602-4a22-90ab-8e2fbe809cab" containerName="extract"
Oct 30 21:27:16.731193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.730511    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="60d92dcf-f112-4dba-baeb-038fa2571688" containerName="extract"
Oct 30 21:27:16.732865 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.732848    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"
Oct 30 21:27:16.764341 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.764313    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:16.784121 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.784097    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"]
Oct 30 21:27:16.788274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.788255    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zkwvh\""
Oct 30 21:27:16.819448 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.819423    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/439ef500-a40f-4afa-b134-e3f43a8cf88d-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4\" (UID: \"439ef500-a40f-4afa-b134-e3f43a8cf88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"
Oct 30 21:27:16.819560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.819463    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjfgv\" (UniqueName: \"kubernetes.io/projected/439ef500-a40f-4afa-b134-e3f43a8cf88d-kube-api-access-wjfgv\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4\" (UID: \"439ef500-a40f-4afa-b134-e3f43a8cf88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"
Oct 30 21:27:16.831881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.831858    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 30 21:27:16.831959 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.831865    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:27:16.920084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.920054    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/439ef500-a40f-4afa-b134-e3f43a8cf88d-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4\" (UID: \"439ef500-a40f-4afa-b134-e3f43a8cf88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"
Oct 30 21:27:16.920233 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.920103    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjfgv\" (UniqueName: \"kubernetes.io/projected/439ef500-a40f-4afa-b134-e3f43a8cf88d-kube-api-access-wjfgv\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4\" (UID: \"439ef500-a40f-4afa-b134-e3f43a8cf88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"
Oct 30 21:27:16.920414 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.920394    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/439ef500-a40f-4afa-b134-e3f43a8cf88d-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4\" (UID: \"439ef500-a40f-4afa-b134-e3f43a8cf88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"
Oct 30 21:27:16.957677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.957647    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:16.981161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:16.981111    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjfgv\" (UniqueName: \"kubernetes.io/projected/439ef500-a40f-4afa-b134-e3f43a8cf88d-kube-api-access-wjfgv\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4\" (UID: \"439ef500-a40f-4afa-b134-e3f43a8cf88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"
Oct 30 21:27:17.043083 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:17.043058    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"
Oct 30 21:27:17.516696 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:17.516666    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4"]
Oct 30 21:27:17.518903 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:27:17.518870    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439ef500_a40f_4afa_b134_e3f43a8cf88d.slice/crio-3a77f1189ca902a96db90167139185e67e8edbf6527cd1fd69e0680f3a1c0eac WatchSource:0}: Error finding container 3a77f1189ca902a96db90167139185e67e8edbf6527cd1fd69e0680f3a1c0eac: Status 404 returned error can't find the container with id 3a77f1189ca902a96db90167139185e67e8edbf6527cd1fd69e0680f3a1c0eac
Oct 30 21:27:17.702105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:17.702070    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4" event={"ID":"439ef500-a40f-4afa-b134-e3f43a8cf88d","Type":"ContainerStarted","Data":"3a77f1189ca902a96db90167139185e67e8edbf6527cd1fd69e0680f3a1c0eac"}
Oct 30 21:27:17.981776 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:17.981746    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:18.148565 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.148535    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"]
Oct 30 21:27:18.151240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.151220    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.209894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.209873    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 21:27:18.210091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.210077    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 21:27:18.230349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.230328    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.230455 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.230365    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.230455 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.230405    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdpvg\" (UniqueName: \"kubernetes.io/projected/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-kube-api-access-fdpvg\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.230706 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.230664    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-tmp\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.230810 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.230749    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-metrics-cert\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.230810 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.230785    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-manifests\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.257730 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.257684    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 21:27:18.257730 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.257714    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 21:27:18.257860 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.257716    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 21:27:18.257860 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.257750    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-9g9fn\""
Oct 30 21:27:18.267137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.267115    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"]
Oct 30 21:27:18.331390 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.331363    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-metrics-cert\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.331501 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.331393    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-manifests\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.331501 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.331441    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.331501 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.331470    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.331664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.331509    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpvg\" (UniqueName: \"kubernetes.io/projected/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-kube-api-access-fdpvg\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.331664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.331556    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-tmp\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.331814 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.331790    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-manifests\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.333784 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.333760    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-tmp\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.334101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.334083    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.334163 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.334101    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-metrics-cert\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.334253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.334229    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.379143 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.379116    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:18.392302 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.392274    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdpvg\" (UniqueName: \"kubernetes.io/projected/349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c-kube-api-access-fdpvg\") pod \"opendatahub-operator-controller-manager-568bcd9cdd-b5x8x\" (UID: \"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.463453 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.463430    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:18.535894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.535854    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:18.684364 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.684327    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:18.847918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:18.847840    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:19.003420 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:27:19.003393    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349d6638_5d2b_4bcf_8a0e_639ed2bc6c9c.slice/crio-12ebbbb0608e374361681d17e5990b599411a6c65c6b10aefa45126b35d9b7f7 WatchSource:0}: Error finding container 12ebbbb0608e374361681d17e5990b599411a6c65c6b10aefa45126b35d9b7f7: Status 404 returned error can't find the container with id 12ebbbb0608e374361681d17e5990b599411a6c65c6b10aefa45126b35d9b7f7
Oct 30 21:27:19.051715 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:19.051693    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"]
Oct 30 21:27:19.138546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:19.138520    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:19.547811 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:19.547729    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:19.713335 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:19.713287    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x" event={"ID":"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c","Type":"ContainerStarted","Data":"12ebbbb0608e374361681d17e5990b599411a6c65c6b10aefa45126b35d9b7f7"}
Oct 30 21:27:19.762534 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:19.762503    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:20.722498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:20.722010    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4" event={"ID":"439ef500-a40f-4afa-b134-e3f43a8cf88d","Type":"ContainerStarted","Data":"e15cbba1d3d0f7cad111ad9f7f7a02c83f34a8efc7d401bfd7fd4a8b0fea32e1"}
Oct 30 21:27:20.942134 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:20.942071    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-g4bg4" podStartSLOduration=2.163750305 podStartE2EDuration="4.942053654s" totalImagesPullingTime="2.778303349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:20.891491827 +0000 UTC m=+241.923340366" watchObservedRunningTime="2026-10-30 21:27:20.942053654 +0000 UTC m=+241.973902189"
Oct 30 21:27:21.339583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:21.339547    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:21.523197 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:21.523156    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:22.187274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:22.187231    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:22.429787 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:22.429750    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:22.733722 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:22.733643    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x" event={"ID":"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c","Type":"ContainerStarted","Data":"940e901da3ff110b909cde2aa7f5bf5ff10e7c253682bce2f80723387fabe7cd"}
Oct 30 21:27:23.483822 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:27:23.483788    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:27:23.541480 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:23.541445    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:23.714020 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:23.713989    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:23.739648 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:23.739573    5575 generic.go:356] "Generic (PLEG): container finished" podID="349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c" containerID="940e901da3ff110b909cde2aa7f5bf5ff10e7c253682bce2f80723387fabe7cd" exitCode=0
Oct 30 21:27:23.739648 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:23.739630    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x" event={"ID":"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c","Type":"ContainerDied","Data":"940e901da3ff110b909cde2aa7f5bf5ff10e7c253682bce2f80723387fabe7cd"}
Oct 30 21:27:24.583173 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:24.583143    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:24.746230 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:24.746202    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x" event={"ID":"349d6638-5d2b-4bcf-8a0e-639ed2bc6c9c","Type":"ContainerStarted","Data":"252cc8461c0369f44c2b0326b77027be816cd7da7e35b1aae21535e312d0b4af"}
Oct 30 21:27:24.746362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:24.746347    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:24.887253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:24.887202    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x" podStartSLOduration=2.066722059 podStartE2EDuration="6.887187317s" totalImagesPullingTime="4.343057598s" totalInitContainerRuntime="477.40766ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:24.884443501 +0000 UTC m=+245.916292035" watchObservedRunningTime="2026-10-30 21:27:24.887187317 +0000 UTC m=+245.919035851"
Oct 30 21:27:25.031584 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:25.031555    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:26.156923 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.156889    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"]
Oct 30 21:27:26.159117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.159100    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"
Oct 30 21:27:26.219222 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.219196    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:27:26.219339 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.219257    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 21:27:26.243280 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.243234    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-9wklx\""
Oct 30 21:27:26.265068 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.265044    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"]
Oct 30 21:27:26.297152 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.297126    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7ad481f-011d-42cf-a71b-911efc4cce8f-tmp\") pod \"jobset-operator-674cd59dc5-tkbmv\" (UID: \"c7ad481f-011d-42cf-a71b-911efc4cce8f\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"
Oct 30 21:27:26.297260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.297186    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgh2n\" (UniqueName: \"kubernetes.io/projected/c7ad481f-011d-42cf-a71b-911efc4cce8f-kube-api-access-hgh2n\") pod \"jobset-operator-674cd59dc5-tkbmv\" (UID: \"c7ad481f-011d-42cf-a71b-911efc4cce8f\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"
Oct 30 21:27:26.398496 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.398471    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgh2n\" (UniqueName: \"kubernetes.io/projected/c7ad481f-011d-42cf-a71b-911efc4cce8f-kube-api-access-hgh2n\") pod \"jobset-operator-674cd59dc5-tkbmv\" (UID: \"c7ad481f-011d-42cf-a71b-911efc4cce8f\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"
Oct 30 21:27:26.398604 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.398526    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7ad481f-011d-42cf-a71b-911efc4cce8f-tmp\") pod \"jobset-operator-674cd59dc5-tkbmv\" (UID: \"c7ad481f-011d-42cf-a71b-911efc4cce8f\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"
Oct 30 21:27:26.398851 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.398835    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7ad481f-011d-42cf-a71b-911efc4cce8f-tmp\") pod \"jobset-operator-674cd59dc5-tkbmv\" (UID: \"c7ad481f-011d-42cf-a71b-911efc4cce8f\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"
Oct 30 21:27:26.464475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.464419    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgh2n\" (UniqueName: \"kubernetes.io/projected/c7ad481f-011d-42cf-a71b-911efc4cce8f-kube-api-access-hgh2n\") pod \"jobset-operator-674cd59dc5-tkbmv\" (UID: \"c7ad481f-011d-42cf-a71b-911efc4cce8f\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"
Oct 30 21:27:26.487233 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.487211    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"
Oct 30 21:27:26.858059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:26.857992    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv"]
Oct 30 21:27:26.860388 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:27:26.860361    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7ad481f_011d_42cf_a71b_911efc4cce8f.slice/crio-851566a9d9d8289e7ce852f826e6d8585852d8a567b82b72239d2342fd11d780 WatchSource:0}: Error finding container 851566a9d9d8289e7ce852f826e6d8585852d8a567b82b72239d2342fd11d780: Status 404 returned error can't find the container with id 851566a9d9d8289e7ce852f826e6d8585852d8a567b82b72239d2342fd11d780
Oct 30 21:27:27.762290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:27.762257    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv" event={"ID":"c7ad481f-011d-42cf-a71b-911efc4cce8f","Type":"ContainerStarted","Data":"851566a9d9d8289e7ce852f826e6d8585852d8a567b82b72239d2342fd11d780"}
Oct 30 21:27:29.715156 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:29.715118    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:29.990091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:29.990010    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:30.148190 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:30.148150    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:30.784567 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:30.784522    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv" event={"ID":"c7ad481f-011d-42cf-a71b-911efc4cce8f","Type":"ContainerStarted","Data":"05b5460f4260c00e236367b0f0a969f48df26993a99576cef48a735b2b0cd9be"}
Oct 30 21:27:30.920335 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:30.920278    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-tkbmv" podStartSLOduration=1.9526613149999998 podStartE2EDuration="4.920264659s" totalImagesPullingTime="2.967603344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:30.91849681 +0000 UTC m=+251.950345350" watchObservedRunningTime="2026-10-30 21:27:30.920264659 +0000 UTC m=+251.952113194"
Oct 30 21:27:31.713496 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:31.713462    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:32.663639 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.663607    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:32.746204 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.746179    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"]
Oct 30 21:27:32.749694 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.749671    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"
Oct 30 21:27:32.805410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.805384    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2q9fj\""
Oct 30 21:27:32.828312 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.828285    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:32.850507 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.850472    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnv5p\" (UniqueName: \"kubernetes.io/projected/00611608-e98a-436f-a822-860104a61b4a-kube-api-access-fnv5p\") pod \"dns-operator-controller-manager-8557cbdb84-6cq94\" (UID: \"00611608-e98a-436f-a822-860104a61b4a\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"
Oct 30 21:27:32.855224 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.855201    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 30 21:27:32.855346 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.855247    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 21:27:32.855346 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.855279    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 21:27:32.857079 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.857061    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"]
Oct 30 21:27:32.951545 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:32.951494    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnv5p\" (UniqueName: \"kubernetes.io/projected/00611608-e98a-436f-a822-860104a61b4a-kube-api-access-fnv5p\") pod \"dns-operator-controller-manager-8557cbdb84-6cq94\" (UID: \"00611608-e98a-436f-a822-860104a61b4a\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"
Oct 30 21:27:33.012541 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:33.012518    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnv5p\" (UniqueName: \"kubernetes.io/projected/00611608-e98a-436f-a822-860104a61b4a-kube-api-access-fnv5p\") pod \"dns-operator-controller-manager-8557cbdb84-6cq94\" (UID: \"00611608-e98a-436f-a822-860104a61b4a\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"
Oct 30 21:27:33.063388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:33.063366    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"
Oct 30 21:27:33.322191 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:33.322123    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:33.436942 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:33.436922    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"]
Oct 30 21:27:33.438814 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:27:33.438790    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00611608_e98a_436f_a822_860104a61b4a.slice/crio-1d8971ac47adab92cff9a617a2c9c9326c76c137205dcd927e8d89db04e137d0 WatchSource:0}: Error finding container 1d8971ac47adab92cff9a617a2c9c9326c76c137205dcd927e8d89db04e137d0: Status 404 returned error can't find the container with id 1d8971ac47adab92cff9a617a2c9c9326c76c137205dcd927e8d89db04e137d0
Oct 30 21:27:33.799298 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:33.799264    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94" event={"ID":"00611608-e98a-436f-a822-860104a61b4a","Type":"ContainerStarted","Data":"1d8971ac47adab92cff9a617a2c9c9326c76c137205dcd927e8d89db04e137d0"}
Oct 30 21:27:33.909506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:33.909477    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:34.768744 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:34.768709    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:34.940307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:34.940275    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:35.753783 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:35.753750    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-568bcd9cdd-b5x8x"
Oct 30 21:27:36.764533 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:36.764496    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"]
Oct 30 21:27:36.768474 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:36.768153    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"
Oct 30 21:27:36.779451 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:36.779415    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:36.782836 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:36.782816    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lx4v\" (UniqueName: \"kubernetes.io/projected/c8fab499-5120-4ae1-a616-922f865cb453-kube-api-access-7lx4v\") pod \"authorino-operator-7b7bb4bc77-ks4qd\" (UID: \"c8fab499-5120-4ae1-a616-922f865cb453\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"
Oct 30 21:27:36.821147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:36.821123    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-svls2\""
Oct 30 21:27:36.828831 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:36.828800    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"]
Oct 30 21:27:36.884502 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:36.884470    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lx4v\" (UniqueName: \"kubernetes.io/projected/c8fab499-5120-4ae1-a616-922f865cb453-kube-api-access-7lx4v\") pod \"authorino-operator-7b7bb4bc77-ks4qd\" (UID: \"c8fab499-5120-4ae1-a616-922f865cb453\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"
Oct 30 21:27:36.947452 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:36.947415    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lx4v\" (UniqueName: \"kubernetes.io/projected/c8fab499-5120-4ae1-a616-922f865cb453-kube-api-access-7lx4v\") pod \"authorino-operator-7b7bb4bc77-ks4qd\" (UID: \"c8fab499-5120-4ae1-a616-922f865cb453\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"
Oct 30 21:27:37.084099 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:37.084076    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"
Oct 30 21:27:37.457938 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:37.457907    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"]
Oct 30 21:27:37.491493 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:27:37.491462    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8fab499_5120_4ae1_a616_922f865cb453.slice/crio-72e4e28426bec7bf3a372b04ed54fac944b90a71114c20630fbf81d459ae5332 WatchSource:0}: Error finding container 72e4e28426bec7bf3a372b04ed54fac944b90a71114c20630fbf81d459ae5332: Status 404 returned error can't find the container with id 72e4e28426bec7bf3a372b04ed54fac944b90a71114c20630fbf81d459ae5332
Oct 30 21:27:37.822548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:37.822446    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94" event={"ID":"00611608-e98a-436f-a822-860104a61b4a","Type":"ContainerStarted","Data":"7a8c9bfe478ede33d77b2a1f8d2eee47e6c9c655bba95a70a0f194e4b974a7ab"}
Oct 30 21:27:37.822548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:37.822522    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"
Oct 30 21:27:37.823809 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:37.823788    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd" event={"ID":"c8fab499-5120-4ae1-a616-922f865cb453","Type":"ContainerStarted","Data":"72e4e28426bec7bf3a372b04ed54fac944b90a71114c20630fbf81d459ae5332"}
Oct 30 21:27:37.907426 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:37.907396    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:37.944238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:37.944188    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94" podStartSLOduration=2.324668653 podStartE2EDuration="5.944174823s" totalImagesPullingTime="3.61950617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:37.942861207 +0000 UTC m=+258.974709744" watchObservedRunningTime="2026-10-30 21:27:37.944174823 +0000 UTC m=+258.976023357"
Oct 30 21:27:38.816189 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:38.816151    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:40.129865 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.129832    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"]
Oct 30 21:27:40.132786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.132768    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"
Oct 30 21:27:40.202343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.202319    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrnsc\" (UniqueName: \"kubernetes.io/projected/4e74afc9-e5b8-4f6e-8906-6fc741c80135-kube-api-access-mrnsc\") pod \"limitador-operator-controller-manager-5778bb4449-wctn4\" (UID: \"4e74afc9-e5b8-4f6e-8906-6fc741c80135\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"
Oct 30 21:27:40.238242 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.238218    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dzs4p\""
Oct 30 21:27:40.241838 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.241810    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"]
Oct 30 21:27:40.303675 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.303651    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrnsc\" (UniqueName: \"kubernetes.io/projected/4e74afc9-e5b8-4f6e-8906-6fc741c80135-kube-api-access-mrnsc\") pod \"limitador-operator-controller-manager-5778bb4449-wctn4\" (UID: \"4e74afc9-e5b8-4f6e-8906-6fc741c80135\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"
Oct 30 21:27:40.369732 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.369697    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrnsc\" (UniqueName: \"kubernetes.io/projected/4e74afc9-e5b8-4f6e-8906-6fc741c80135-kube-api-access-mrnsc\") pod \"limitador-operator-controller-manager-5778bb4449-wctn4\" (UID: \"4e74afc9-e5b8-4f6e-8906-6fc741c80135\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"
Oct 30 21:27:40.446406 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.446382    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"
Oct 30 21:27:40.738785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.738682    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:40.822848 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.822824    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"]
Oct 30 21:27:40.824519 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:27:40.824488    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e74afc9_e5b8_4f6e_8906_6fc741c80135.slice/crio-30f786af7f9aaf01a4c2545310deabe15ab14a09df9afec85d0e9f306bd4744e WatchSource:0}: Error finding container 30f786af7f9aaf01a4c2545310deabe15ab14a09df9afec85d0e9f306bd4744e: Status 404 returned error can't find the container with id 30f786af7f9aaf01a4c2545310deabe15ab14a09df9afec85d0e9f306bd4744e
Oct 30 21:27:40.841000 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.840950    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4" event={"ID":"4e74afc9-e5b8-4f6e-8906-6fc741c80135","Type":"ContainerStarted","Data":"30f786af7f9aaf01a4c2545310deabe15ab14a09df9afec85d0e9f306bd4744e"}
Oct 30 21:27:40.842442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.842422    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd" event={"ID":"c8fab499-5120-4ae1-a616-922f865cb453","Type":"ContainerStarted","Data":"32d981d231bd490b4f57eb74dcaad4249c618ead76fd0591293fbe01a64582d9"}
Oct 30 21:27:40.842567 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.842554    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"
Oct 30 21:27:40.968984 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:40.968923    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd" podStartSLOduration=2.320772966 podStartE2EDuration="4.968909909s" totalImagesPullingTime="2.648136943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:40.966108259 +0000 UTC m=+261.997956794" watchObservedRunningTime="2026-10-30 21:27:40.968909909 +0000 UTC m=+262.000758443"
Oct 30 21:27:41.317442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:41.317407    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:41.710089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:41.710061    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:41.927890 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:41.927861    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:42.980474 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:42.980438    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:43.860575 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:43.860544    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4" event={"ID":"4e74afc9-e5b8-4f6e-8906-6fc741c80135","Type":"ContainerStarted","Data":"266c7ef34fc0a8a0d468752007027562a6e254c519a7f61f377cc3c7c451796c"}
Oct 30 21:27:43.860737 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:43.860723    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"
Oct 30 21:27:43.979227 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:43.979172    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4" podStartSLOduration=1.5530897769999998 podStartE2EDuration="3.979156992s" totalImagesPullingTime="2.426067215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:43.978367755 +0000 UTC m=+265.010216293" watchObservedRunningTime="2026-10-30 21:27:43.979156992 +0000 UTC m=+265.011005527"
Oct 30 21:27:44.391661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:44.391621    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:44.547288 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:44.547263    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:45.697145 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.697112    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"]
Oct 30 21:27:45.700747 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.700720    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:27:45.748869 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.748840    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b408058e-f89c-4b4a-a3b5-bd06a840daac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-sdmgd\" (UID: \"b408058e-f89c-4b4a-a3b5-bd06a840daac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:27:45.749000 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.748897    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvtv8\" (UniqueName: \"kubernetes.io/projected/b408058e-f89c-4b4a-a3b5-bd06a840daac-kube-api-access-fvtv8\") pod \"kuadrant-operator-controller-manager-678d87766f-sdmgd\" (UID: \"b408058e-f89c-4b4a-a3b5-bd06a840daac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:27:45.753129 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.753107    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z6krb\""
Oct 30 21:27:45.762654 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.762632    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"]
Oct 30 21:27:45.850026 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.849989    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvtv8\" (UniqueName: \"kubernetes.io/projected/b408058e-f89c-4b4a-a3b5-bd06a840daac-kube-api-access-fvtv8\") pod \"kuadrant-operator-controller-manager-678d87766f-sdmgd\" (UID: \"b408058e-f89c-4b4a-a3b5-bd06a840daac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:27:45.850207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.850040    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b408058e-f89c-4b4a-a3b5-bd06a840daac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-sdmgd\" (UID: \"b408058e-f89c-4b4a-a3b5-bd06a840daac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:27:45.850456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.850438    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b408058e-f89c-4b4a-a3b5-bd06a840daac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-sdmgd\" (UID: \"b408058e-f89c-4b4a-a3b5-bd06a840daac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:27:45.913745 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:45.913719    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvtv8\" (UniqueName: \"kubernetes.io/projected/b408058e-f89c-4b4a-a3b5-bd06a840daac-kube-api-access-fvtv8\") pod \"kuadrant-operator-controller-manager-678d87766f-sdmgd\" (UID: \"b408058e-f89c-4b4a-a3b5-bd06a840daac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:27:46.013204 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:46.013141    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:27:46.438549 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:46.438522    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"]
Oct 30 21:27:46.441032 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:27:46.441000    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb408058e_f89c_4b4a_a3b5_bd06a840daac.slice/crio-5bf28d4738ddefdb7937498b1cf43d4612a94bf59ab952275b8c3752c90fac09 WatchSource:0}: Error finding container 5bf28d4738ddefdb7937498b1cf43d4612a94bf59ab952275b8c3752c90fac09: Status 404 returned error can't find the container with id 5bf28d4738ddefdb7937498b1cf43d4612a94bf59ab952275b8c3752c90fac09
Oct 30 21:27:46.537133 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:46.537101    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:46.753591 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:46.753518    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:46.876201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:46.876169    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd" event={"ID":"b408058e-f89c-4b4a-a3b5-bd06a840daac","Type":"ContainerStarted","Data":"5bf28d4738ddefdb7937498b1cf43d4612a94bf59ab952275b8c3752c90fac09"}
Oct 30 21:27:48.831656 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:48.831630    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6cq94"
Oct 30 21:27:51.710913 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:51.710820    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:51.849875 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:51.849851    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-ks4qd"
Oct 30 21:27:51.870450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:51.870419    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:51.906946 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:51.906916    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd" event={"ID":"b408058e-f89c-4b4a-a3b5-bd06a840daac","Type":"ContainerStarted","Data":"7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477"}
Oct 30 21:27:51.907092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:51.907012    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:27:52.042116 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:52.042045    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:52.093876 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:52.093825    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd" podStartSLOduration=2.283628486 podStartE2EDuration="7.093810957s" totalImagesPullingTime="4.810182471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:52.091846406 +0000 UTC m=+273.123694941" watchObservedRunningTime="2026-10-30 21:27:52.093810957 +0000 UTC m=+273.125659492"
Oct 30 21:27:53.484288 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:27:53.484249    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:27:54.380917 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:54.380890    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:54.531523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:54.531476    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:54.867939 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:54.867870    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-wctn4"
Oct 30 21:27:55.571767 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:55.571734    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:55.799566 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:55.799532    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:56.016771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:56.016740    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:56.185317 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:56.185290    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:57.213932 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:57.213898    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:57.412638 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:57.412592    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:57.771146 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:57.771109    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:58.691170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:58.691133    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:58.850673 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:58.850644    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:59.131688 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.131644    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:59.297498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.297469    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:59.482882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.482807    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:59.784777 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.784699    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:59.831229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.831199    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"]
Oct 30 21:27:59.835199 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.835176    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.879511 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.879487    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/873d8eb5-e464-48c1-8eee-d23233240558-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.879636 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.879517    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pqh2\" (UniqueName: \"kubernetes.io/projected/873d8eb5-e464-48c1-8eee-d23233240558-kube-api-access-6pqh2\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.879636 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.879540    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.879636 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.879619    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.879747 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.879674    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/873d8eb5-e464-48c1-8eee-d23233240558-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.879747 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.879722    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/873d8eb5-e464-48c1-8eee-d23233240558-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.879842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.879776    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.879842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.879815    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.879909 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.879837    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.887560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.887535    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4ms6q\""
Oct 30 21:27:59.940760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.940731    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"]
Oct 30 21:27:59.945850 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.945822    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:59.980670 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.980642    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.980796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.980679    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.980796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.980717    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/873d8eb5-e464-48c1-8eee-d23233240558-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.980796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.980733    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pqh2\" (UniqueName: \"kubernetes.io/projected/873d8eb5-e464-48c1-8eee-d23233240558-kube-api-access-6pqh2\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.980796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.980754    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.980796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.980795    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.981085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.980838    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/873d8eb5-e464-48c1-8eee-d23233240558-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.981085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.980904    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/873d8eb5-e464-48c1-8eee-d23233240558-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.981085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.980935    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.981237 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.981167    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.981237 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.981223    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.981374 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.981287    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.981374 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.981342    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.981663 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.981641    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/873d8eb5-e464-48c1-8eee-d23233240558-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.983346 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.983321    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/873d8eb5-e464-48c1-8eee-d23233240558-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:27:59.983435 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:27:59.983422    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/873d8eb5-e464-48c1-8eee-d23233240558-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:28:00.045476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.045413    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/873d8eb5-e464-48c1-8eee-d23233240558-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:28:00.046007 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.045961    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pqh2\" (UniqueName: \"kubernetes.io/projected/873d8eb5-e464-48c1-8eee-d23233240558-kube-api-access-6pqh2\") pod \"data-science-gateway-data-science-gateway-class-84d4d45d7cj8467\" (UID: \"873d8eb5-e464-48c1-8eee-d23233240558\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:28:00.146368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.146331    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:00.148358 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.148340    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:28:00.577697 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.577674    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"]
Oct 30 21:28:00.579596 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:28:00.579570    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873d8eb5_e464_48c1_8eee_d23233240558.slice/crio-e08bf1fed87679bc0b728b6be734b64c4eb69733447105f87bbdd9dc35a0abb4 WatchSource:0}: Error finding container e08bf1fed87679bc0b728b6be734b64c4eb69733447105f87bbdd9dc35a0abb4: Status 404 returned error can't find the container with id e08bf1fed87679bc0b728b6be734b64c4eb69733447105f87bbdd9dc35a0abb4
Oct 30 21:28:00.581862 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.581834    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:28:00.581934 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.581898    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:28:00.581934 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.581927    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:28:00.705564 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.705519    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:00.865643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.865542    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:00.955622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.955585    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467" event={"ID":"873d8eb5-e464-48c1-8eee-d23233240558","Type":"ContainerStarted","Data":"b885eac0abd1f5d101e01bba9b9b924e28a999cba68847f445cd3557cfcc57c2"}
Oct 30 21:28:00.955816 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:00.955650    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467" event={"ID":"873d8eb5-e464-48c1-8eee-d23233240558","Type":"ContainerStarted","Data":"e08bf1fed87679bc0b728b6be734b64c4eb69733447105f87bbdd9dc35a0abb4"}
Oct 30 21:28:01.021637 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:01.021608    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:01.093069 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:01.090898    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467" podStartSLOduration=2.090879239 podStartE2EDuration="2.090879239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:01.087696443 +0000 UTC m=+282.119544981" watchObservedRunningTime="2026-10-30 21:28:01.090879239 +0000 UTC m=+282.122727779"
Oct 30 21:28:01.148909 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:01.148879    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:28:01.153795 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:01.153775    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:28:01.932112 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:01.932081    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:01.960675 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:01.960637    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:28:01.961667 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:01.961647    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cj8467"
Oct 30 21:28:02.254542 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:02.254402    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:02.423607 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:02.423574    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:02.914669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:02.914635    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 21:28:03.667069 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:03.667034    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-f62lg"]
Oct 30 21:28:03.671103 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:03.671085    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-f62lg"
Oct 30 21:28:03.726799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:03.726774    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2ztqt\""
Oct 30 21:28:03.727535 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:03.727512    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-f62lg"]
Oct 30 21:28:03.817847 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:03.817815    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mxp8\" (UniqueName: \"kubernetes.io/projected/08553fd1-13d3-4c5c-b11b-e5d464c5aa54-kube-api-access-6mxp8\") pod \"authorino-57f7f8659f-f62lg\" (UID: \"08553fd1-13d3-4c5c-b11b-e5d464c5aa54\") " pod="kuadrant-system/authorino-57f7f8659f-f62lg"
Oct 30 21:28:03.853272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:03.853239    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:03.918723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:03.918655    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mxp8\" (UniqueName: \"kubernetes.io/projected/08553fd1-13d3-4c5c-b11b-e5d464c5aa54-kube-api-access-6mxp8\") pod \"authorino-57f7f8659f-f62lg\" (UID: \"08553fd1-13d3-4c5c-b11b-e5d464c5aa54\") " pod="kuadrant-system/authorino-57f7f8659f-f62lg"
Oct 30 21:28:03.989777 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:03.989744    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mxp8\" (UniqueName: \"kubernetes.io/projected/08553fd1-13d3-4c5c-b11b-e5d464c5aa54-kube-api-access-6mxp8\") pod \"authorino-57f7f8659f-f62lg\" (UID: \"08553fd1-13d3-4c5c-b11b-e5d464c5aa54\") " pod="kuadrant-system/authorino-57f7f8659f-f62lg"
Oct 30 21:28:04.069364 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:04.069323    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:04.284011 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:04.283913    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-f62lg"
Oct 30 21:28:04.658769 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:04.658742    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-f62lg"]
Oct 30 21:28:04.660711 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:28:04.660681    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08553fd1_13d3_4c5c_b11b_e5d464c5aa54.slice/crio-aab2c0ed02a63d0da86145aec9f66eb7245e8483511542b3511bcfdacf3aa949 WatchSource:0}: Error finding container aab2c0ed02a63d0da86145aec9f66eb7245e8483511542b3511bcfdacf3aa949: Status 404 returned error can't find the container with id aab2c0ed02a63d0da86145aec9f66eb7245e8483511542b3511bcfdacf3aa949
Oct 30 21:28:04.977245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:04.977166    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-f62lg" event={"ID":"08553fd1-13d3-4c5c-b11b-e5d464c5aa54","Type":"ContainerStarted","Data":"aab2c0ed02a63d0da86145aec9f66eb7245e8483511542b3511bcfdacf3aa949"}
Oct 30 21:28:05.373640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:05.373548    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqfd6"]
Oct 30 21:28:05.378828 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:05.378805    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6"
Oct 30 21:28:05.435397 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:05.435362    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqfd6"]
Oct 30 21:28:05.539459 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:05.539427    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fzwn\" (UniqueName: \"kubernetes.io/projected/25a04ffb-f017-4b61-b97e-ea61df6bed56-kube-api-access-7fzwn\") pod \"authorino-56c6c9ddd5-tqfd6\" (UID: \"25a04ffb-f017-4b61-b97e-ea61df6bed56\") " pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6"
Oct 30 21:28:05.640733 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:05.640705    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fzwn\" (UniqueName: \"kubernetes.io/projected/25a04ffb-f017-4b61-b97e-ea61df6bed56-kube-api-access-7fzwn\") pod \"authorino-56c6c9ddd5-tqfd6\" (UID: \"25a04ffb-f017-4b61-b97e-ea61df6bed56\") " pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6"
Oct 30 21:28:05.704509 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:05.704476    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fzwn\" (UniqueName: \"kubernetes.io/projected/25a04ffb-f017-4b61-b97e-ea61df6bed56-kube-api-access-7fzwn\") pod \"authorino-56c6c9ddd5-tqfd6\" (UID: \"25a04ffb-f017-4b61-b97e-ea61df6bed56\") " pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6"
Oct 30 21:28:05.782807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:05.782776    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:05.937667 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:05.937597    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:05.992717 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:05.992689    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6"
Oct 30 21:28:06.364145 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:06.364114    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqfd6"]
Oct 30 21:28:06.366090 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:28:06.366066    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25a04ffb_f017_4b61_b97e_ea61df6bed56.slice/crio-0986c410c26a12af2dc223c3877824f87d7308e0215b889d7a7f759b8314d186 WatchSource:0}: Error finding container 0986c410c26a12af2dc223c3877824f87d7308e0215b889d7a7f759b8314d186: Status 404 returned error can't find the container with id 0986c410c26a12af2dc223c3877824f87d7308e0215b889d7a7f759b8314d186
Oct 30 21:28:06.988899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:06.988858    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6" event={"ID":"25a04ffb-f017-4b61-b97e-ea61df6bed56","Type":"ContainerStarted","Data":"0986c410c26a12af2dc223c3877824f87d7308e0215b889d7a7f759b8314d186"}
Oct 30 21:28:07.145912 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:07.145867    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:07.998449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:07.998333    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6" event={"ID":"25a04ffb-f017-4b61-b97e-ea61df6bed56","Type":"ContainerStarted","Data":"aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd"}
Oct 30 21:28:08.000774 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:08.000743    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-f62lg" event={"ID":"08553fd1-13d3-4c5c-b11b-e5d464c5aa54","Type":"ContainerStarted","Data":"de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c"}
Oct 30 21:28:08.116833 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:08.116778    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6" podStartSLOduration=1.848400196 podStartE2EDuration="3.116762348s" totalImagesPullingTime="1.268362152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:08.11547826 +0000 UTC m=+289.147326794" watchObservedRunningTime="2026-10-30 21:28:08.116762348 +0000 UTC m=+289.148610874"
Oct 30 21:28:08.149692 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:08.149662    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-f62lg"]
Oct 30 21:28:08.232825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:08.232765    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-f62lg" podStartSLOduration=2.604387291 podStartE2EDuration="5.232745537s" totalImagesPullingTime="2.628358246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:08.231479368 +0000 UTC m=+289.263327902" watchObservedRunningTime="2026-10-30 21:28:08.232745537 +0000 UTC m=+289.264594074"
Oct 30 21:28:10.011536 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:10.011502    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-f62lg" podUID="08553fd1-13d3-4c5c-b11b-e5d464c5aa54" containerName="authorino" containerID="cri-o://de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c" gracePeriod=30
Oct 30 21:28:10.259735 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:10.259708    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-f62lg"
Oct 30 21:28:10.390290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:10.390261    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08553fd1-13d3-4c5c-b11b-e5d464c5aa54-kube-api-access-6mxp8\" (UniqueName: \"kubernetes.io/projected/08553fd1-13d3-4c5c-b11b-e5d464c5aa54-kube-api-access-6mxp8\") pod \"08553fd1-13d3-4c5c-b11b-e5d464c5aa54\" (UID: \"08553fd1-13d3-4c5c-b11b-e5d464c5aa54\") "
Oct 30 21:28:10.392906 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:10.392874    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08553fd1-13d3-4c5c-b11b-e5d464c5aa54-kube-api-access-6mxp8" pod "08553fd1-13d3-4c5c-b11b-e5d464c5aa54" (UID: "08553fd1-13d3-4c5c-b11b-e5d464c5aa54"). InnerVolumeSpecName "kube-api-access-6mxp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:28:10.491421 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:10.491394    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mxp8\" (UniqueName: \"kubernetes.io/projected/08553fd1-13d3-4c5c-b11b-e5d464c5aa54-kube-api-access-6mxp8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:11.019270 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.019231    5575 generic.go:356] "Generic (PLEG): container finished" podID="08553fd1-13d3-4c5c-b11b-e5d464c5aa54" containerID="de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c" exitCode=0
Oct 30 21:28:11.019687 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.019292    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-f62lg" event={"ID":"08553fd1-13d3-4c5c-b11b-e5d464c5aa54","Type":"ContainerDied","Data":"de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c"}
Oct 30 21:28:11.019687 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.019325    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-f62lg" event={"ID":"08553fd1-13d3-4c5c-b11b-e5d464c5aa54","Type":"ContainerDied","Data":"aab2c0ed02a63d0da86145aec9f66eb7245e8483511542b3511bcfdacf3aa949"}
Oct 30 21:28:11.019687 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.019343    5575 scope.go:122] "RemoveContainer" containerID="de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c"
Oct 30 21:28:11.019687 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.019295    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-f62lg"
Oct 30 21:28:11.028886 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.028869    5575 scope.go:122] "RemoveContainer" containerID="de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c"
Oct 30 21:28:11.029175 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:28:11.029155    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c\": container with ID starting with de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c not found: ID does not exist" containerID="de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c"
Oct 30 21:28:11.029251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.029188    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c"} err="failed to get container status \"de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c\": rpc error: code = NotFound desc = could not find container \"de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c\": container with ID starting with de335302b75ece629529a349ff07b7bceb6cc83df142edea4b90056da13ece6c not found: ID does not exist"
Oct 30 21:28:11.178608 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.178576    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:11.191486 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.191464    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-f62lg"]
Oct 30 21:28:11.196183 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.196160    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-f62lg"]
Oct 30 21:28:11.336282 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.336168    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:11.577256 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.577227    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:11.796537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.796509    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:11.855260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.855230    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"]
Oct 30 21:28:11.855603 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.855591    5575 cpu_manager.go:414] "containerMap: removing container" podUID="08553fd1-13d3-4c5c-b11b-e5d464c5aa54" containerName="authorino"
Oct 30 21:28:11.855645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.855604    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08553fd1-13d3-4c5c-b11b-e5d464c5aa54" containerName="authorino"
Oct 30 21:28:11.855678 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.855666    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="08553fd1-13d3-4c5c-b11b-e5d464c5aa54" containerName="authorino"
Oct 30 21:28:11.858726 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.858709    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:11.911466 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.911444    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 21:28:11.911466 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.911463    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 21:28:11.911664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:11.911499    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-gjj8s\""
Oct 30 21:28:12.006357 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.006325    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8047500b-7a83-47fa-a632-646c9f7964d0-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.006357 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.006366    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8047500b-7a83-47fa-a632-646c9f7964d0-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.006583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.006556    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g85tf\" (UniqueName: \"kubernetes.io/projected/8047500b-7a83-47fa-a632-646c9f7964d0-kube-api-access-g85tf\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.006632 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.006615    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8047500b-7a83-47fa-a632-646c9f7964d0-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.061818 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.061735    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 30 21:28:12.063899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.063879    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"]
Oct 30 21:28:12.108000 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.107958    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8047500b-7a83-47fa-a632-646c9f7964d0-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.108108 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.108011    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8047500b-7a83-47fa-a632-646c9f7964d0-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.108108 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.108063    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g85tf\" (UniqueName: \"kubernetes.io/projected/8047500b-7a83-47fa-a632-646c9f7964d0-kube-api-access-g85tf\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.108108 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.108089    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8047500b-7a83-47fa-a632-646c9f7964d0-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.108373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.108347    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8047500b-7a83-47fa-a632-646c9f7964d0-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.108415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.108359    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8047500b-7a83-47fa-a632-646c9f7964d0-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.108759 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.108743    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8047500b-7a83-47fa-a632-646c9f7964d0-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.169257 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.169229    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g85tf\" (UniqueName: \"kubernetes.io/projected/8047500b-7a83-47fa-a632-646c9f7964d0-kube-api-access-g85tf\") pod \"kserve-module-controller-manager-7566cf5fc8-9cjz7\" (UID: \"8047500b-7a83-47fa-a632-646c9f7964d0\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.170020 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.169994    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:12.593475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:12.593452    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"]
Oct 30 21:28:12.595630 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:28:12.595603    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8047500b_7a83_47fa_a632_646c9f7964d0.slice/crio-1b13da7f17a31c9717cd4d623d12b5e57e54637dc5725b51af57564082e33a5c WatchSource:0}: Error finding container 1b13da7f17a31c9717cd4d623d12b5e57e54637dc5725b51af57564082e33a5c: Status 404 returned error can't find the container with id 1b13da7f17a31c9717cd4d623d12b5e57e54637dc5725b51af57564082e33a5c
Oct 30 21:28:13.033287 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:13.033255    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7" event={"ID":"8047500b-7a83-47fa-a632-646c9f7964d0","Type":"ContainerStarted","Data":"1b13da7f17a31c9717cd4d623d12b5e57e54637dc5725b51af57564082e33a5c"}
Oct 30 21:28:13.124975 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:13.124931    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="08553fd1-13d3-4c5c-b11b-e5d464c5aa54" path="/var/lib/kubelet/pods/08553fd1-13d3-4c5c-b11b-e5d464c5aa54/volumes"
Oct 30 21:28:14.972005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:14.971934    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:15.123529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:15.123495    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:16.052505 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:16.052465    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7" event={"ID":"8047500b-7a83-47fa-a632-646c9f7964d0","Type":"ContainerStarted","Data":"85aa91244c2911d8c32eb18ba1e30e947875958127e0263692d005ae86548506"}
Oct 30 21:28:16.052957 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:16.052556    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:16.230827 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:16.230773    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7" podStartSLOduration=2.467115123 podStartE2EDuration="5.230759924s" totalImagesPullingTime="2.763644801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:16.229110715 +0000 UTC m=+297.260959251" watchObservedRunningTime="2026-10-30 21:28:16.230759924 +0000 UTC m=+297.262608459"
Oct 30 21:28:18.799819 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:18.799785    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:19.026478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:19.026442    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:19.145336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:19.145303    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:28:19.145922 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:19.145899    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:28:19.161153 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:19.161131    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:28:19.161857 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:19.161836    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:28:23.484802 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:28:23.484765    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:28:29.749146 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:29.749110    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:29.916245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:29.916213    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:30.397929 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.397901    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"]
Oct 30 21:28:30.400511 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.400496    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:30.456838 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.456813    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:28:30.458397 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.458367    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbdjm\" (UniqueName: \"kubernetes.io/projected/cd3206bd-3b48-4d2b-8117-6ef55de0e4bf-kube-api-access-xbdjm\") pod \"postgres-7cdbf6dc44-hhgtr\" (UID: \"cd3206bd-3b48-4d2b-8117-6ef55de0e4bf\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:30.458536 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.458434    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cd3206bd-3b48-4d2b-8117-6ef55de0e4bf-data\") pod \"postgres-7cdbf6dc44-hhgtr\" (UID: \"cd3206bd-3b48-4d2b-8117-6ef55de0e4bf\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:30.495651 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.495628    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:30.502745 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.502728    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 21:28:30.502834 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.502754    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qgqfj\""
Oct 30 21:28:30.502834 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.502780    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:28:30.504824 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.504794    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"]
Oct 30 21:28:30.559523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.559499    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbdjm\" (UniqueName: \"kubernetes.io/projected/cd3206bd-3b48-4d2b-8117-6ef55de0e4bf-kube-api-access-xbdjm\") pod \"postgres-7cdbf6dc44-hhgtr\" (UID: \"cd3206bd-3b48-4d2b-8117-6ef55de0e4bf\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:30.559675 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.559540    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cd3206bd-3b48-4d2b-8117-6ef55de0e4bf-data\") pod \"postgres-7cdbf6dc44-hhgtr\" (UID: \"cd3206bd-3b48-4d2b-8117-6ef55de0e4bf\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:30.559839 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.559822    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cd3206bd-3b48-4d2b-8117-6ef55de0e4bf-data\") pod \"postgres-7cdbf6dc44-hhgtr\" (UID: \"cd3206bd-3b48-4d2b-8117-6ef55de0e4bf\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:30.620766 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.620738    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbdjm\" (UniqueName: \"kubernetes.io/projected/cd3206bd-3b48-4d2b-8117-6ef55de0e4bf-kube-api-access-xbdjm\") pod \"postgres-7cdbf6dc44-hhgtr\" (UID: \"cd3206bd-3b48-4d2b-8117-6ef55de0e4bf\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:30.712378 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:30.712309    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:31.089121 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:31.087956    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"]
Oct 30 21:28:31.090812 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:31.090787    5575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:28:31.129624 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:31.129598    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr" event={"ID":"cd3206bd-3b48-4d2b-8117-6ef55de0e4bf","Type":"ContainerStarted","Data":"d45d833811cc5879f7364aa5699a8313d7b37c591e0315a94f67572ab312229f"}
Oct 30 21:28:37.058765 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:37.058728    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9cjz7"
Oct 30 21:28:38.176198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:38.176164    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr" event={"ID":"cd3206bd-3b48-4d2b-8117-6ef55de0e4bf","Type":"ContainerStarted","Data":"1004edb4c6ed9ac08011a405d3696628bf7d207ac2b481197ee48654bc231ae7"}
Oct 30 21:28:38.176578 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:38.176240    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:38.293699 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:38.293647    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr" podStartSLOduration=1.920694203 podStartE2EDuration="8.29363367s" totalImagesPullingTime="6.372939467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:38.292494337 +0000 UTC m=+319.324342872" watchObservedRunningTime="2026-10-30 21:28:38.29363367 +0000 UTC m=+319.325482205"
Oct 30 21:28:42.127577 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:42.127539    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:44.210336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:44.210303    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hhgtr"
Oct 30 21:28:51.306989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:51.306912    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:51.473191 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:51.473158    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:51.624731 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:51.624629    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:51.786236 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:51.786203    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:53.484369 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:28:53.484328    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:28:55.634874 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:55.634825    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:55.789103 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:55.789071    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:58.854107 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:58.854074    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:59.157091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:28:59.157058    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:10.760209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:10.760175    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:10.914717 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:10.914673    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:18.091420 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:18.091374    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:18.254074 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:18.254040    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:18.404618 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:18.404591    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:18.568896 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:18.568861    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:18.747222 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:18.747149    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:18.904616 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:18.904578    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:18.960182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:18.960157    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-trrhk"]
Oct 30 21:29:18.979565 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:18.979544    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:29:19.022331 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.022278    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-trrhk"]
Oct 30 21:29:19.037223 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.037195    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5bwxv\""
Oct 30 21:29:19.037403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.037320    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 21:29:19.068928 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.068892    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:19.071135 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.071106    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbx2h\" (UniqueName: \"kubernetes.io/projected/ac58a90c-a768-4ba1-80a2-0e84ae0a102b-kube-api-access-hbx2h\") pod \"kserve-controller-manager-776cc66d47-trrhk\" (UID: \"ac58a90c-a768-4ba1-80a2-0e84ae0a102b\") " pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:29:19.071267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.071139    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac58a90c-a768-4ba1-80a2-0e84ae0a102b-cert\") pod \"kserve-controller-manager-776cc66d47-trrhk\" (UID: \"ac58a90c-a768-4ba1-80a2-0e84ae0a102b\") " pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:29:19.172121 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.172095    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbx2h\" (UniqueName: \"kubernetes.io/projected/ac58a90c-a768-4ba1-80a2-0e84ae0a102b-kube-api-access-hbx2h\") pod \"kserve-controller-manager-776cc66d47-trrhk\" (UID: \"ac58a90c-a768-4ba1-80a2-0e84ae0a102b\") " pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:29:19.172531 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.172129    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac58a90c-a768-4ba1-80a2-0e84ae0a102b-cert\") pod \"kserve-controller-manager-776cc66d47-trrhk\" (UID: \"ac58a90c-a768-4ba1-80a2-0e84ae0a102b\") " pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:29:19.223683 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.223656    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 21:29:19.225981 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.225937    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:19.234118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.234095    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbx2h\" (UniqueName: \"kubernetes.io/projected/ac58a90c-a768-4ba1-80a2-0e84ae0a102b-kube-api-access-hbx2h\") pod \"kserve-controller-manager-776cc66d47-trrhk\" (UID: \"ac58a90c-a768-4ba1-80a2-0e84ae0a102b\") " pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:29:19.235136 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.235115    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac58a90c-a768-4ba1-80a2-0e84ae0a102b-cert\") pod \"kserve-controller-manager-776cc66d47-trrhk\" (UID: \"ac58a90c-a768-4ba1-80a2-0e84ae0a102b\") " pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:29:19.302054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.302000    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-t2f8s"]
Oct 30 21:29:19.305538 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.305521    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.343456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.343438    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5bwxv\""
Oct 30 21:29:19.352091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.352069    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:29:19.358539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.358518    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f75w4\""
Oct 30 21:29:19.358657 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.358631    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 21:29:19.358783 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.358741    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 21:29:19.364718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.364696    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-t2f8s"]
Oct 30 21:29:19.374521 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.374497    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1144bae-6f6e-49f9-b8a4-fe44d80a4a40-cert\") pod \"odh-model-controller-769875db56-t2f8s\" (UID: \"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40\") " pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.374617 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.374547    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6txs9\" (UniqueName: \"kubernetes.io/projected/c1144bae-6f6e-49f9-b8a4-fe44d80a4a40-kube-api-access-6txs9\") pod \"odh-model-controller-769875db56-t2f8s\" (UID: \"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40\") " pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.374664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.374623    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1144bae-6f6e-49f9-b8a4-fe44d80a4a40-metrics-certs\") pod \"odh-model-controller-769875db56-t2f8s\" (UID: \"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40\") " pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.475386 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.475353    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txs9\" (UniqueName: \"kubernetes.io/projected/c1144bae-6f6e-49f9-b8a4-fe44d80a4a40-kube-api-access-6txs9\") pod \"odh-model-controller-769875db56-t2f8s\" (UID: \"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40\") " pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.475386 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.475388    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1144bae-6f6e-49f9-b8a4-fe44d80a4a40-metrics-certs\") pod \"odh-model-controller-769875db56-t2f8s\" (UID: \"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40\") " pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.475583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.475462    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1144bae-6f6e-49f9-b8a4-fe44d80a4a40-cert\") pod \"odh-model-controller-769875db56-t2f8s\" (UID: \"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40\") " pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.478028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.477996    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1144bae-6f6e-49f9-b8a4-fe44d80a4a40-metrics-certs\") pod \"odh-model-controller-769875db56-t2f8s\" (UID: \"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40\") " pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.478162 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.478141    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1144bae-6f6e-49f9-b8a4-fe44d80a4a40-cert\") pod \"odh-model-controller-769875db56-t2f8s\" (UID: \"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40\") " pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.537140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.537113    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6txs9\" (UniqueName: \"kubernetes.io/projected/c1144bae-6f6e-49f9-b8a4-fe44d80a4a40-kube-api-access-6txs9\") pod \"odh-model-controller-769875db56-t2f8s\" (UID: \"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40\") " pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.617897 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.617838    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:19.755991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.755952    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-trrhk"]
Oct 30 21:29:19.758061 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:29:19.758031    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac58a90c_a768_4ba1_80a2_0e84ae0a102b.slice/crio-ce099a59a3efa3119fbfe2eb934ddd34854afe14c646f94256aa7a0c71b01448 WatchSource:0}: Error finding container ce099a59a3efa3119fbfe2eb934ddd34854afe14c646f94256aa7a0c71b01448: Status 404 returned error can't find the container with id ce099a59a3efa3119fbfe2eb934ddd34854afe14c646f94256aa7a0c71b01448
Oct 30 21:29:19.990129 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:19.990104    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-t2f8s"]
Oct 30 21:29:19.991956 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:29:19.991934    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1144bae_6f6e_49f9_b8a4_fe44d80a4a40.slice/crio-e3f4996c4d9162764aa20e969e8287453ba7b185e31c8ac77fccea5da4045d2d WatchSource:0}: Error finding container e3f4996c4d9162764aa20e969e8287453ba7b185e31c8ac77fccea5da4045d2d: Status 404 returned error can't find the container with id e3f4996c4d9162764aa20e969e8287453ba7b185e31c8ac77fccea5da4045d2d
Oct 30 21:29:20.366114 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:20.366044    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:20.403657 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:20.403628    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-t2f8s" event={"ID":"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40","Type":"ContainerStarted","Data":"e3f4996c4d9162764aa20e969e8287453ba7b185e31c8ac77fccea5da4045d2d"}
Oct 30 21:29:20.404852 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:20.404827    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk" event={"ID":"ac58a90c-a768-4ba1-80a2-0e84ae0a102b","Type":"ContainerStarted","Data":"ce099a59a3efa3119fbfe2eb934ddd34854afe14c646f94256aa7a0c71b01448"}
Oct 30 21:29:23.426054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:23.426011    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-t2f8s" event={"ID":"c1144bae-6f6e-49f9-b8a4-fe44d80a4a40","Type":"ContainerStarted","Data":"154d4cc1747e0efe67d06eb75fe163389ccaa0a98e8352adbe90f49d65f60785"}
Oct 30 21:29:23.426507 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:23.426205    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:23.427571 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:23.427545    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk" event={"ID":"ac58a90c-a768-4ba1-80a2-0e84ae0a102b","Type":"ContainerStarted","Data":"5976bf99f29ce462df0b33be996cc1aef438dd248eb1d9ed69a03564ff363232"}
Oct 30 21:29:23.427690 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:23.427653    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:29:23.485503 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:29:23.485469    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:29:23.545936 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:23.545892    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-t2f8s" podStartSLOduration=1.464295481 podStartE2EDuration="4.545879167s" totalImagesPullingTime="3.081583686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:23.543796628 +0000 UTC m=+364.575645165" watchObservedRunningTime="2026-10-30 21:29:23.545879167 +0000 UTC m=+364.577727702"
Oct 30 21:29:23.661553 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:23.661500    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk" podStartSLOduration=3.049159292 podStartE2EDuration="5.661485315s" totalImagesPullingTime="2.612326023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:23.660244564 +0000 UTC m=+364.692093100" watchObservedRunningTime="2026-10-30 21:29:23.661485315 +0000 UTC m=+364.693333847"
Oct 30 21:29:25.325224 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:25.325182    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:25.495030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:25.494995    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:25.660429 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:25.660393    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:25.887063 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:25.887035    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:26.039506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:26.039406    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:26.196002 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:26.195931    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:26.359775 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:26.359691    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:26.521791 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:26.521739    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:26.679799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:26.679767    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:26.837856 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:26.837806    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:27.448447 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:27.448414    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:27.602255 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:27.602224    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:27.763827 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:27.763731    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:27.921906 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:27.921868    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:34.434904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:34.434829    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-t2f8s"
Oct 30 21:29:38.604137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:38.604100    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:38.824507 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:38.824471    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:38.888119 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:38.888085    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-bchjp"]
Oct 30 21:29:38.892794 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:38.892773    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-bchjp"
Oct 30 21:29:38.950250 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:38.950219    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-bchjp"]
Oct 30 21:29:38.974365 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:38.974327    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grnr6\" (UniqueName: \"kubernetes.io/projected/b8aaf7db-1b3b-4854-9495-f3bcf5cadfce-kube-api-access-grnr6\") pod \"authorino-6f6944bcdd-bchjp\" (UID: \"b8aaf7db-1b3b-4854-9495-f3bcf5cadfce\") " pod="kuadrant-system/authorino-6f6944bcdd-bchjp"
Oct 30 21:29:39.075321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.075286    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grnr6\" (UniqueName: \"kubernetes.io/projected/b8aaf7db-1b3b-4854-9495-f3bcf5cadfce-kube-api-access-grnr6\") pod \"authorino-6f6944bcdd-bchjp\" (UID: \"b8aaf7db-1b3b-4854-9495-f3bcf5cadfce\") " pod="kuadrant-system/authorino-6f6944bcdd-bchjp"
Oct 30 21:29:39.138660 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.138590    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grnr6\" (UniqueName: \"kubernetes.io/projected/b8aaf7db-1b3b-4854-9495-f3bcf5cadfce-kube-api-access-grnr6\") pod \"authorino-6f6944bcdd-bchjp\" (UID: \"b8aaf7db-1b3b-4854-9495-f3bcf5cadfce\") " pod="kuadrant-system/authorino-6f6944bcdd-bchjp"
Oct 30 21:29:39.207857 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.207820    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-bchjp"
Oct 30 21:29:39.292489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.292458    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-bchjp"]
Oct 30 21:29:39.325285 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.325258    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f857b5dcc-hpkdk"]
Oct 30 21:29:39.328977 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.328948    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk"
Oct 30 21:29:39.385467 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.385442    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f857b5dcc-hpkdk"]
Oct 30 21:29:39.479585 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.479495    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvmq2\" (UniqueName: \"kubernetes.io/projected/79bad8db-fbbb-4f33-9117-81bba6b64477-kube-api-access-vvmq2\") pod \"authorino-5f857b5dcc-hpkdk\" (UID: \"79bad8db-fbbb-4f33-9117-81bba6b64477\") " pod="kuadrant-system/authorino-5f857b5dcc-hpkdk"
Oct 30 21:29:39.581103 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.581050    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvmq2\" (UniqueName: \"kubernetes.io/projected/79bad8db-fbbb-4f33-9117-81bba6b64477-kube-api-access-vvmq2\") pod \"authorino-5f857b5dcc-hpkdk\" (UID: \"79bad8db-fbbb-4f33-9117-81bba6b64477\") " pod="kuadrant-system/authorino-5f857b5dcc-hpkdk"
Oct 30 21:29:39.586859 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.586833    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-bchjp"]
Oct 30 21:29:39.588566 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:29:39.588538    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8aaf7db_1b3b_4854_9495_f3bcf5cadfce.slice/crio-1f1b484ff6d56a75b85fadaf33dd525521c3598c7b0f7ab37d4db2ae7135079d WatchSource:0}: Error finding container 1f1b484ff6d56a75b85fadaf33dd525521c3598c7b0f7ab37d4db2ae7135079d: Status 404 returned error can't find the container with id 1f1b484ff6d56a75b85fadaf33dd525521c3598c7b0f7ab37d4db2ae7135079d
Oct 30 21:29:39.642066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.642038    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvmq2\" (UniqueName: \"kubernetes.io/projected/79bad8db-fbbb-4f33-9117-81bba6b64477-kube-api-access-vvmq2\") pod \"authorino-5f857b5dcc-hpkdk\" (UID: \"79bad8db-fbbb-4f33-9117-81bba6b64477\") " pod="kuadrant-system/authorino-5f857b5dcc-hpkdk"
Oct 30 21:29:39.642388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.642159    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk"
Oct 30 21:29:39.727942 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.727909    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f857b5dcc-hpkdk"]
Oct 30 21:29:39.755812 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.755744    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58d5d6454c-9m58t"]
Oct 30 21:29:39.759388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.759364    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:29:39.814467 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.814438    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 21:29:39.816828 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.816803    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58d5d6454c-9m58t"]
Oct 30 21:29:39.883876 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.883843    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lq78\" (UniqueName: \"kubernetes.io/projected/feb3d94f-b066-42fc-9812-dfe5e5097d24-kube-api-access-4lq78\") pod \"authorino-58d5d6454c-9m58t\" (UID: \"feb3d94f-b066-42fc-9812-dfe5e5097d24\") " pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:29:39.884048 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.883903    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/feb3d94f-b066-42fc-9812-dfe5e5097d24-tls-cert\") pod \"authorino-58d5d6454c-9m58t\" (UID: \"feb3d94f-b066-42fc-9812-dfe5e5097d24\") " pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:29:39.985234 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.985200    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/feb3d94f-b066-42fc-9812-dfe5e5097d24-tls-cert\") pod \"authorino-58d5d6454c-9m58t\" (UID: \"feb3d94f-b066-42fc-9812-dfe5e5097d24\") " pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:29:39.985390 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.985272    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lq78\" (UniqueName: \"kubernetes.io/projected/feb3d94f-b066-42fc-9812-dfe5e5097d24-kube-api-access-4lq78\") pod \"authorino-58d5d6454c-9m58t\" (UID: \"feb3d94f-b066-42fc-9812-dfe5e5097d24\") " pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:29:39.987986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:39.987946    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/feb3d94f-b066-42fc-9812-dfe5e5097d24-tls-cert\") pod \"authorino-58d5d6454c-9m58t\" (UID: \"feb3d94f-b066-42fc-9812-dfe5e5097d24\") " pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:29:40.021419 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.021391    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f857b5dcc-hpkdk"]
Oct 30 21:29:40.023144 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:29:40.023104    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79bad8db_fbbb_4f33_9117_81bba6b64477.slice/crio-d0dff5dd5b8724dd0b4dd10b56fc6611aa5de046a521b406ed86995959d76d02 WatchSource:0}: Error finding container d0dff5dd5b8724dd0b4dd10b56fc6611aa5de046a521b406ed86995959d76d02: Status 404 returned error can't find the container with id d0dff5dd5b8724dd0b4dd10b56fc6611aa5de046a521b406ed86995959d76d02
Oct 30 21:29:40.047143 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.047110    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lq78\" (UniqueName: \"kubernetes.io/projected/feb3d94f-b066-42fc-9812-dfe5e5097d24-kube-api-access-4lq78\") pod \"authorino-58d5d6454c-9m58t\" (UID: \"feb3d94f-b066-42fc-9812-dfe5e5097d24\") " pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:29:40.071104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.071072    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:29:40.173126 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.173094    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6q26d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:29:40.173304 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.173154    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:29:40.445869 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.443891    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58d5d6454c-9m58t"]
Oct 30 21:29:40.446260 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:29:40.446234    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfeb3d94f_b066_42fc_9812_dfe5e5097d24.slice/crio-3045a2d702f219509fca9bd13df8cb1310f020ecb4618153074fc9267af9e5f0 WatchSource:0}: Error finding container 3045a2d702f219509fca9bd13df8cb1310f020ecb4618153074fc9267af9e5f0: Status 404 returned error can't find the container with id 3045a2d702f219509fca9bd13df8cb1310f020ecb4618153074fc9267af9e5f0
Oct 30 21:29:40.526036 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.526005    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58d5d6454c-9m58t" event={"ID":"feb3d94f-b066-42fc-9812-dfe5e5097d24","Type":"ContainerStarted","Data":"3045a2d702f219509fca9bd13df8cb1310f020ecb4618153074fc9267af9e5f0"}
Oct 30 21:29:40.527274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.527250    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-bchjp" event={"ID":"b8aaf7db-1b3b-4854-9495-f3bcf5cadfce","Type":"ContainerStarted","Data":"1f1b484ff6d56a75b85fadaf33dd525521c3598c7b0f7ab37d4db2ae7135079d"}
Oct 30 21:29:40.531673 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.531652    5575 generic.go:356] "Generic (PLEG): container finished" podID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerID="659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0" exitCode=0
Oct 30 21:29:40.531767 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.531726    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" event={"ID":"404ed8ef-1e29-490e-bd9a-1b8453b42f2a","Type":"ContainerDied","Data":"659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0"}
Oct 30 21:29:40.532187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.532169    5575 scope.go:122] "RemoveContainer" containerID="659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0"
Oct 30 21:29:40.533004 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.532952    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk" event={"ID":"79bad8db-fbbb-4f33-9117-81bba6b64477","Type":"ContainerStarted","Data":"d0dff5dd5b8724dd0b4dd10b56fc6611aa5de046a521b406ed86995959d76d02"}
Oct 30 21:29:40.533292 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.533268    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:40.533348 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.533335    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:40.533382 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:40.533368    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:41.541597 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:41.541492    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" event={"ID":"404ed8ef-1e29-490e-bd9a-1b8453b42f2a","Type":"ContainerStarted","Data":"ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4"}
Oct 30 21:29:41.543498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:41.543464    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-bchjp" event={"ID":"b8aaf7db-1b3b-4854-9495-f3bcf5cadfce","Type":"ContainerStarted","Data":"fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665"}
Oct 30 21:29:41.543616 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:41.543571    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-bchjp" podUID="b8aaf7db-1b3b-4854-9495-f3bcf5cadfce" containerName="authorino" containerID="cri-o://fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665" gracePeriod=30
Oct 30 21:29:41.791742 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:41.791688    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-bchjp" podStartSLOduration=2.220667857 podStartE2EDuration="3.7916736s" totalImagesPullingTime="1.571005743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:41.790534203 +0000 UTC m=+382.822382747" watchObservedRunningTime="2026-10-30 21:29:41.7916736 +0000 UTC m=+382.823522134"
Oct 30 21:29:41.856882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:41.856859    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-bchjp"
Oct 30 21:29:42.004322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.004281    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8aaf7db-1b3b-4854-9495-f3bcf5cadfce-kube-api-access-grnr6\" (UniqueName: \"kubernetes.io/projected/b8aaf7db-1b3b-4854-9495-f3bcf5cadfce-kube-api-access-grnr6\") pod \"b8aaf7db-1b3b-4854-9495-f3bcf5cadfce\" (UID: \"b8aaf7db-1b3b-4854-9495-f3bcf5cadfce\") "
Oct 30 21:29:42.033989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.031120    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8aaf7db-1b3b-4854-9495-f3bcf5cadfce-kube-api-access-grnr6" pod "b8aaf7db-1b3b-4854-9495-f3bcf5cadfce" (UID: "b8aaf7db-1b3b-4854-9495-f3bcf5cadfce"). InnerVolumeSpecName "kube-api-access-grnr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:42.105274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.105203    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grnr6\" (UniqueName: \"kubernetes.io/projected/b8aaf7db-1b3b-4854-9495-f3bcf5cadfce-kube-api-access-grnr6\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:42.231240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.231198    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:29:42.231504 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.231479    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6q26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:29:42.231576 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.231535    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 21:29:42.401040 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.401005    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:42.559903 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.559868    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58d5d6454c-9m58t" event={"ID":"feb3d94f-b066-42fc-9812-dfe5e5097d24","Type":"ContainerStarted","Data":"1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5"}
Oct 30 21:29:42.562124 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.562099    5575 generic.go:356] "Generic (PLEG): container finished" podID="b8aaf7db-1b3b-4854-9495-f3bcf5cadfce" containerID="fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665" exitCode=0
Oct 30 21:29:42.562244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.562209    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-bchjp" event={"ID":"b8aaf7db-1b3b-4854-9495-f3bcf5cadfce","Type":"ContainerDied","Data":"fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665"}
Oct 30 21:29:42.562244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.562233    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-bchjp" event={"ID":"b8aaf7db-1b3b-4854-9495-f3bcf5cadfce","Type":"ContainerDied","Data":"1f1b484ff6d56a75b85fadaf33dd525521c3598c7b0f7ab37d4db2ae7135079d"}
Oct 30 21:29:42.562339 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.562248    5575 scope.go:122] "RemoveContainer" containerID="fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665"
Oct 30 21:29:42.562380 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.562358    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-bchjp"
Oct 30 21:29:42.566042 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.565820    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk" podUID="79bad8db-fbbb-4f33-9117-81bba6b64477" containerName="authorino" containerID="cri-o://99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92" gracePeriod=30
Oct 30 21:29:42.566178 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.566154    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk" event={"ID":"79bad8db-fbbb-4f33-9117-81bba6b64477","Type":"ContainerStarted","Data":"99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92"}
Oct 30 21:29:42.582773 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.581397    5575 scope.go:122] "RemoveContainer" containerID="fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665"
Oct 30 21:29:42.586651 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:29:42.586223    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665\": container with ID starting with fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665 not found: ID does not exist" containerID="fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665"
Oct 30 21:29:42.586651 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.586281    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665"} err="failed to get container status \"fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665\": rpc error: code = NotFound desc = could not find container \"fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665\": container with ID starting with fc167fa8c0a90810c2deeb29cce4f234ac83a722b07fee8a84bfbdcd55681665 not found: ID does not exist"
Oct 30 21:29:42.684047 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.682024    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-58d5d6454c-9m58t" podStartSLOduration=2.348877255 podStartE2EDuration="3.682003909s" totalImagesPullingTime="1.333126654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:42.679298631 +0000 UTC m=+383.711147169" watchObservedRunningTime="2026-10-30 21:29:42.682003909 +0000 UTC m=+383.713852440"
Oct 30 21:29:42.748033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.744574    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqfd6"]
Oct 30 21:29:42.748033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.744853    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6" podUID="25a04ffb-f017-4b61-b97e-ea61df6bed56" containerName="authorino" containerID="cri-o://aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd" gracePeriod=30
Oct 30 21:29:42.799552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.799488    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk" podStartSLOduration=2.181587367 podStartE2EDuration="3.799468836s" totalImagesPullingTime="1.617881469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:42.798605735 +0000 UTC m=+383.830454271" watchObservedRunningTime="2026-10-30 21:29:42.799468836 +0000 UTC m=+383.831317372"
Oct 30 21:29:42.927990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.923884    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-bchjp"]
Oct 30 21:29:42.948087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.948061    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-bchjp"]
Oct 30 21:29:42.952167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:42.952146    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk"
Oct 30 21:29:43.070618 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.070587    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6"
Oct 30 21:29:43.140642 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.140610    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8aaf7db-1b3b-4854-9495-f3bcf5cadfce" path="/var/lib/kubelet/pods/b8aaf7db-1b3b-4854-9495-f3bcf5cadfce/volumes"
Oct 30 21:29:43.144912 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.144882    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79bad8db-fbbb-4f33-9117-81bba6b64477-kube-api-access-vvmq2\" (UniqueName: \"kubernetes.io/projected/79bad8db-fbbb-4f33-9117-81bba6b64477-kube-api-access-vvmq2\") pod \"79bad8db-fbbb-4f33-9117-81bba6b64477\" (UID: \"79bad8db-fbbb-4f33-9117-81bba6b64477\") "
Oct 30 21:29:43.147491 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.147467    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79bad8db-fbbb-4f33-9117-81bba6b64477-kube-api-access-vvmq2" pod "79bad8db-fbbb-4f33-9117-81bba6b64477" (UID: "79bad8db-fbbb-4f33-9117-81bba6b64477"). InnerVolumeSpecName "kube-api-access-vvmq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:43.237465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.237374    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6q26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:29:43.237465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.237427    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 21:29:43.246204 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.246171    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25a04ffb-f017-4b61-b97e-ea61df6bed56-kube-api-access-7fzwn\" (UniqueName: \"kubernetes.io/projected/25a04ffb-f017-4b61-b97e-ea61df6bed56-kube-api-access-7fzwn\") pod \"25a04ffb-f017-4b61-b97e-ea61df6bed56\" (UID: \"25a04ffb-f017-4b61-b97e-ea61df6bed56\") "
Oct 30 21:29:43.246407 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.246393    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvmq2\" (UniqueName: \"kubernetes.io/projected/79bad8db-fbbb-4f33-9117-81bba6b64477-kube-api-access-vvmq2\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:43.249554 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.249297    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a04ffb-f017-4b61-b97e-ea61df6bed56-kube-api-access-7fzwn" pod "25a04ffb-f017-4b61-b97e-ea61df6bed56" (UID: "25a04ffb-f017-4b61-b97e-ea61df6bed56"). InnerVolumeSpecName "kube-api-access-7fzwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:43.346959 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.346920    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fzwn\" (UniqueName: \"kubernetes.io/projected/25a04ffb-f017-4b61-b97e-ea61df6bed56-kube-api-access-7fzwn\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:43.573144 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.573057    5575 generic.go:356] "Generic (PLEG): container finished" podID="79bad8db-fbbb-4f33-9117-81bba6b64477" containerID="99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92" exitCode=0
Oct 30 21:29:43.573144 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.573113    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk"
Oct 30 21:29:43.573686 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.573146    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk" event={"ID":"79bad8db-fbbb-4f33-9117-81bba6b64477","Type":"ContainerDied","Data":"99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92"}
Oct 30 21:29:43.573686 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.573194    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f857b5dcc-hpkdk" event={"ID":"79bad8db-fbbb-4f33-9117-81bba6b64477","Type":"ContainerDied","Data":"d0dff5dd5b8724dd0b4dd10b56fc6611aa5de046a521b406ed86995959d76d02"}
Oct 30 21:29:43.573686 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.573205    5575 scope.go:122] "RemoveContainer" containerID="99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92"
Oct 30 21:29:43.574619 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.574508    5575 generic.go:356] "Generic (PLEG): container finished" podID="25a04ffb-f017-4b61-b97e-ea61df6bed56" containerID="aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd" exitCode=0
Oct 30 21:29:43.574619 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.574548    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6"
Oct 30 21:29:43.574619 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.574575    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6" event={"ID":"25a04ffb-f017-4b61-b97e-ea61df6bed56","Type":"ContainerDied","Data":"aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd"}
Oct 30 21:29:43.574619 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.574597    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-tqfd6" event={"ID":"25a04ffb-f017-4b61-b97e-ea61df6bed56","Type":"ContainerDied","Data":"0986c410c26a12af2dc223c3877824f87d7308e0215b889d7a7f759b8314d186"}
Oct 30 21:29:43.583784 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.583763    5575 scope.go:122] "RemoveContainer" containerID="99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92"
Oct 30 21:29:43.584118 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:29:43.584086    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92\": container with ID starting with 99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92 not found: ID does not exist" containerID="99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92"
Oct 30 21:29:43.584198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.584112    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92"} err="failed to get container status \"99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92\": rpc error: code = NotFound desc = could not find container \"99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92\": container with ID starting with 99f810b37e746e76acc1618d991ca378aa27a0d94dcf31247d44f2ef97557c92 not found: ID does not exist"
Oct 30 21:29:43.584198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.584128    5575 scope.go:122] "RemoveContainer" containerID="aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd"
Oct 30 21:29:43.592579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.592560    5575 scope.go:122] "RemoveContainer" containerID="aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd"
Oct 30 21:29:43.592846 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:29:43.592828    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd\": container with ID starting with aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd not found: ID does not exist" containerID="aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd"
Oct 30 21:29:43.592900 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.592854    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd"} err="failed to get container status \"aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd\": rpc error: code = NotFound desc = could not find container \"aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd\": container with ID starting with aa2787b60f542bcef2e9870ee87673b8ab89f6f5cae2ed0532403ec9c2a8b8bd not found: ID does not exist"
Oct 30 21:29:43.738033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.738001    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f857b5dcc-hpkdk"]
Oct 30 21:29:43.742028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.742004    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f857b5dcc-hpkdk"]
Oct 30 21:29:43.852099 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.852026    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqfd6"]
Oct 30 21:29:43.855576 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:43.855548    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqfd6"]
Oct 30 21:29:44.231393 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:44.231356    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6q26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:29:44.231574 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:44.231423    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 21:29:45.135571 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:45.135530    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25a04ffb-f017-4b61-b97e-ea61df6bed56" path="/var/lib/kubelet/pods/25a04ffb-f017-4b61-b97e-ea61df6bed56/volumes"
Oct 30 21:29:45.136109 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:45.136037    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79bad8db-fbbb-4f33-9117-81bba6b64477" path="/var/lib/kubelet/pods/79bad8db-fbbb-4f33-9117-81bba6b64477/volumes"
Oct 30 21:29:45.231335 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:45.231299    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6q26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:29:45.231524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:45.231367    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 21:29:46.230991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:46.230329    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6q26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:29:46.230991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:46.230390    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 21:29:46.820462 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:46.820425    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:47.233708 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:47.233674    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:29:47.234085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:47.233994    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:29:47.234603 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:47.234584    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:29:47.783512 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:47.783479    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:53.484739 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:29:53.484705    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:29:54.438384 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:29:54.438356    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-trrhk"
Oct 30 21:30:00.170504 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.170470    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"]
Oct 30 21:30:00.170954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.170882    5575 cpu_manager.go:414] "containerMap: removing container" podUID="79bad8db-fbbb-4f33-9117-81bba6b64477" containerName="authorino"
Oct 30 21:30:00.170954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.170892    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79bad8db-fbbb-4f33-9117-81bba6b64477" containerName="authorino"
Oct 30 21:30:00.170954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.170909    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b8aaf7db-1b3b-4854-9495-f3bcf5cadfce" containerName="authorino"
Oct 30 21:30:00.170954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.170916    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8aaf7db-1b3b-4854-9495-f3bcf5cadfce" containerName="authorino"
Oct 30 21:30:00.170954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.170928    5575 cpu_manager.go:414] "containerMap: removing container" podUID="25a04ffb-f017-4b61-b97e-ea61df6bed56" containerName="authorino"
Oct 30 21:30:00.170954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.170933    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25a04ffb-f017-4b61-b97e-ea61df6bed56" containerName="authorino"
Oct 30 21:30:00.171169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.171035    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="79bad8db-fbbb-4f33-9117-81bba6b64477" containerName="authorino"
Oct 30 21:30:00.171169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.171045    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8aaf7db-1b3b-4854-9495-f3bcf5cadfce" containerName="authorino"
Oct 30 21:30:00.171169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.171051    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="25a04ffb-f017-4b61-b97e-ea61df6bed56" containerName="authorino"
Oct 30 21:30:00.173078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.173055    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:00.225748 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.225725    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 21:30:00.278019 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.277986    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"]
Oct 30 21:30:00.289166 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.289138    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ae6455-f4d2-494f-89d8-7692fd1e655a-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889930-fhsdt\" (UID: \"26ae6455-f4d2-494f-89d8-7692fd1e655a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:00.289301 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.289170    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtt7b\" (UniqueName: \"kubernetes.io/projected/26ae6455-f4d2-494f-89d8-7692fd1e655a-kube-api-access-wtt7b\") pod \"maas-api-key-cleanup-29889930-fhsdt\" (UID: \"26ae6455-f4d2-494f-89d8-7692fd1e655a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:00.389690 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.389656    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ae6455-f4d2-494f-89d8-7692fd1e655a-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889930-fhsdt\" (UID: \"26ae6455-f4d2-494f-89d8-7692fd1e655a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:00.389853 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.389695    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtt7b\" (UniqueName: \"kubernetes.io/projected/26ae6455-f4d2-494f-89d8-7692fd1e655a-kube-api-access-wtt7b\") pod \"maas-api-key-cleanup-29889930-fhsdt\" (UID: \"26ae6455-f4d2-494f-89d8-7692fd1e655a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:00.390296 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.390278    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ae6455-f4d2-494f-89d8-7692fd1e655a-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889930-fhsdt\" (UID: \"26ae6455-f4d2-494f-89d8-7692fd1e655a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:00.451182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.451119    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtt7b\" (UniqueName: \"kubernetes.io/projected/26ae6455-f4d2-494f-89d8-7692fd1e655a-kube-api-access-wtt7b\") pod \"maas-api-key-cleanup-29889930-fhsdt\" (UID: \"26ae6455-f4d2-494f-89d8-7692fd1e655a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:00.484035 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.484013    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:00.859591 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.859569    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"]
Oct 30 21:30:00.861501 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:30:00.861474    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ae6455_f4d2_494f_89d8_7692fd1e655a.slice/crio-fdd990ffdae3231c3a974c8aa7ac2904971bfbf8d1a82cebe7e5be17aa003b24 WatchSource:0}: Error finding container fdd990ffdae3231c3a974c8aa7ac2904971bfbf8d1a82cebe7e5be17aa003b24: Status 404 returned error can't find the container with id fdd990ffdae3231c3a974c8aa7ac2904971bfbf8d1a82cebe7e5be17aa003b24
Oct 30 21:30:00.920593 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:00.920563    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:01.692890 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:01.692850    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" event={"ID":"26ae6455-f4d2-494f-89d8-7692fd1e655a","Type":"ContainerStarted","Data":"fdd990ffdae3231c3a974c8aa7ac2904971bfbf8d1a82cebe7e5be17aa003b24"}
Oct 30 21:30:05.717048 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:05.716979    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" event={"ID":"26ae6455-f4d2-494f-89d8-7692fd1e655a","Type":"ContainerStarted","Data":"b6b2ecd3c05626e3f314bcdede897b231fbc415a95ad753e0e69b7e5404bb67b"}
Oct 30 21:30:05.833891 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:05.833842    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" podStartSLOduration=1.281202577 podStartE2EDuration="5.833829978s" totalImagesPullingTime="4.552627401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:05.832692947 +0000 UTC m=+406.864541473" watchObservedRunningTime="2026-10-30 21:30:05.833829978 +0000 UTC m=+406.865678509"
Oct 30 21:30:06.724403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:06.724370    5575 generic.go:356] "Generic (PLEG): container finished" podID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerID="b6b2ecd3c05626e3f314bcdede897b231fbc415a95ad753e0e69b7e5404bb67b" exitCode=60
Oct 30 21:30:06.724826 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:06.724427    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" event={"ID":"26ae6455-f4d2-494f-89d8-7692fd1e655a","Type":"ContainerDied","Data":"b6b2ecd3c05626e3f314bcdede897b231fbc415a95ad753e0e69b7e5404bb67b"}
Oct 30 21:30:06.724826 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:06.724672    5575 scope.go:122] "RemoveContainer" containerID="b6b2ecd3c05626e3f314bcdede897b231fbc415a95ad753e0e69b7e5404bb67b"
Oct 30 21:30:07.732482 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:07.732394    5575 generic.go:356] "Generic (PLEG): container finished" podID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerID="c9a7b9014c61c7f45736baf6bf4f43439698e3807f25cf83bccb7dec3ce69c7e" exitCode=60
Oct 30 21:30:07.732940 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:07.732479    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" event={"ID":"26ae6455-f4d2-494f-89d8-7692fd1e655a","Type":"ContainerDied","Data":"c9a7b9014c61c7f45736baf6bf4f43439698e3807f25cf83bccb7dec3ce69c7e"}
Oct 30 21:30:07.732940 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:07.732535    5575 scope.go:122] "RemoveContainer" containerID="b6b2ecd3c05626e3f314bcdede897b231fbc415a95ad753e0e69b7e5404bb67b"
Oct 30 21:30:07.732940 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:07.732734    5575 scope.go:122] "RemoveContainer" containerID="c9a7b9014c61c7f45736baf6bf4f43439698e3807f25cf83bccb7dec3ce69c7e"
Oct 30 21:30:07.733107 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:30:07.732999    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889930-fhsdt_odh-ai-gateway-infra(26ae6455-f4d2-494f-89d8-7692fd1e655a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a"
Oct 30 21:30:08.740223 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:08.740197    5575 scope.go:122] "RemoveContainer" containerID="c9a7b9014c61c7f45736baf6bf4f43439698e3807f25cf83bccb7dec3ce69c7e"
Oct 30 21:30:08.740596 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:30:08.740376    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889930-fhsdt_odh-ai-gateway-infra(26ae6455-f4d2-494f-89d8-7692fd1e655a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a"
Oct 30 21:30:20.119769 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:20.119740    5575 scope.go:122] "RemoveContainer" containerID="c9a7b9014c61c7f45736baf6bf4f43439698e3807f25cf83bccb7dec3ce69c7e"
Oct 30 21:30:20.819051 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:20.819018    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" event={"ID":"26ae6455-f4d2-494f-89d8-7692fd1e655a","Type":"ContainerStarted","Data":"cabe1a4d28da59d0b699f8c9b2a2251f296068deb5af5978bc9f4ffb27214a9d"}
Oct 30 21:30:21.825841 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:21.825808    5575 generic.go:356] "Generic (PLEG): container finished" podID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerID="cabe1a4d28da59d0b699f8c9b2a2251f296068deb5af5978bc9f4ffb27214a9d" exitCode=60
Oct 30 21:30:21.826307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:21.825886    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" event={"ID":"26ae6455-f4d2-494f-89d8-7692fd1e655a","Type":"ContainerDied","Data":"cabe1a4d28da59d0b699f8c9b2a2251f296068deb5af5978bc9f4ffb27214a9d"}
Oct 30 21:30:21.826307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:21.825945    5575 scope.go:122] "RemoveContainer" containerID="c9a7b9014c61c7f45736baf6bf4f43439698e3807f25cf83bccb7dec3ce69c7e"
Oct 30 21:30:21.826307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:21.826222    5575 scope.go:122] "RemoveContainer" containerID="cabe1a4d28da59d0b699f8c9b2a2251f296068deb5af5978bc9f4ffb27214a9d"
Oct 30 21:30:21.826459 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:30:21.826439    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29889930-fhsdt_odh-ai-gateway-infra(26ae6455-f4d2-494f-89d8-7692fd1e655a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a"
Oct 30 21:30:21.953608 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:21.953579    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"]
Oct 30 21:30:22.970412 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:22.970391    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:23.069339 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:23.069306    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/26ae6455-f4d2-494f-89d8-7692fd1e655a-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ae6455-f4d2-494f-89d8-7692fd1e655a-maas-api-service-ca\") pod \"26ae6455-f4d2-494f-89d8-7692fd1e655a\" (UID: \"26ae6455-f4d2-494f-89d8-7692fd1e655a\") "
Oct 30 21:30:23.069476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:23.069348    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26ae6455-f4d2-494f-89d8-7692fd1e655a-kube-api-access-wtt7b\" (UniqueName: \"kubernetes.io/projected/26ae6455-f4d2-494f-89d8-7692fd1e655a-kube-api-access-wtt7b\") pod \"26ae6455-f4d2-494f-89d8-7692fd1e655a\" (UID: \"26ae6455-f4d2-494f-89d8-7692fd1e655a\") "
Oct 30 21:30:23.069719 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:23.069696    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ae6455-f4d2-494f-89d8-7692fd1e655a-maas-api-service-ca" pod "26ae6455-f4d2-494f-89d8-7692fd1e655a" (UID: "26ae6455-f4d2-494f-89d8-7692fd1e655a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:23.071563 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:23.071539    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ae6455-f4d2-494f-89d8-7692fd1e655a-kube-api-access-wtt7b" pod "26ae6455-f4d2-494f-89d8-7692fd1e655a" (UID: "26ae6455-f4d2-494f-89d8-7692fd1e655a"). InnerVolumeSpecName "kube-api-access-wtt7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:23.170558 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:23.170533    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ae6455-f4d2-494f-89d8-7692fd1e655a-maas-api-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:23.170558 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:23.170555    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtt7b\" (UniqueName: \"kubernetes.io/projected/26ae6455-f4d2-494f-89d8-7692fd1e655a-kube-api-access-wtt7b\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:23.484739 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:30:23.484648    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:30:23.843622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:23.843547    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"
Oct 30 21:30:23.843622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:23.843554    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt" event={"ID":"26ae6455-f4d2-494f-89d8-7692fd1e655a","Type":"ContainerDied","Data":"fdd990ffdae3231c3a974c8aa7ac2904971bfbf8d1a82cebe7e5be17aa003b24"}
Oct 30 21:30:23.843622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:23.843617    5575 scope.go:122] "RemoveContainer" containerID="cabe1a4d28da59d0b699f8c9b2a2251f296068deb5af5978bc9f4ffb27214a9d"
Oct 30 21:30:24.008293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:24.008260    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"]
Oct 30 21:30:24.057901 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:24.057878    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889930-fhsdt"]
Oct 30 21:30:25.124904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:25.124876    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" path="/var/lib/kubelet/pods/26ae6455-f4d2-494f-89d8-7692fd1e655a/volumes"
Oct 30 21:30:42.742692 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:30:42.742656    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:53.485519 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:30:53.485482    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:31:07.615522 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:07.615488    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:07.770680 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:07.770646    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:17.548827 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:17.548789    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:18.425862 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:18.425827    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:18.590932 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:18.590901    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:23.484637 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:31:23.484602    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:31:35.323539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:35.323506    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:39.471431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:39.471393    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:43.111411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.111383    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:43.236811 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.236766    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"]
Oct 30 21:31:43.237843 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.237810    5575 cpu_manager.go:414] "containerMap: removing container" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerName="cleanup"
Oct 30 21:31:43.237843 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.237842    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerName="cleanup"
Oct 30 21:31:43.238077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.237866    5575 cpu_manager.go:414] "containerMap: removing container" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerName="cleanup"
Oct 30 21:31:43.238077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.237874    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerName="cleanup"
Oct 30 21:31:43.238077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.237898    5575 cpu_manager.go:414] "containerMap: removing container" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerName="cleanup"
Oct 30 21:31:43.238077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.237906    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerName="cleanup"
Oct 30 21:31:43.238077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.238026    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerName="cleanup"
Oct 30 21:31:43.238077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.238047    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerName="cleanup"
Oct 30 21:31:43.241717 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.241694    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.298300 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.298263    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 21:31:43.344194 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.344116    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:43.349094 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.348302    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lt9rb\""
Oct 30 21:31:43.349094 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.348388    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 21:31:43.351906 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.351876    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"]
Oct 30 21:31:43.353277 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.353249    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.353411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.353309    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.353483 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.353411    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.353483 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.353442    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hffl\" (UniqueName: \"kubernetes.io/projected/5550810b-b9ac-4e61-a2de-c00bec116d9f-kube-api-access-2hffl\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.353483 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.353473    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.353637 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.353521    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5550810b-b9ac-4e61-a2de-c00bec116d9f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.398327 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.398297    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Oct 30 21:31:43.454997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.454929    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.455198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.455048    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.455198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.455077    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hffl\" (UniqueName: \"kubernetes.io/projected/5550810b-b9ac-4e61-a2de-c00bec116d9f-kube-api-access-2hffl\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.455198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.455101    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.455198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.455148    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5550810b-b9ac-4e61-a2de-c00bec116d9f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.455198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.455175    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.455661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.455434    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.455844 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.455824    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.456077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.456051    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.458566 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.458545    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5550810b-b9ac-4e61-a2de-c00bec116d9f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.461642 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.461618    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5550810b-b9ac-4e61-a2de-c00bec116d9f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.521392 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.521350    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hffl\" (UniqueName: \"kubernetes.io/projected/5550810b-b9ac-4e61-a2de-c00bec116d9f-kube-api-access-2hffl\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f\" (UID: \"5550810b-b9ac-4e61-a2de-c00bec116d9f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.563268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.563230    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:43.942615 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:43.942590    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"]
Oct 30 21:31:43.944246 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:31:43.944218    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5550810b_b9ac_4e61_a2de_c00bec116d9f.slice/crio-1822098a5343beb7aecb72a1e40839392ce10af53fd242f128ae1a99ecec50fa WatchSource:0}: Error finding container 1822098a5343beb7aecb72a1e40839392ce10af53fd242f128ae1a99ecec50fa: Status 404 returned error can't find the container with id 1822098a5343beb7aecb72a1e40839392ce10af53fd242f128ae1a99ecec50fa
Oct 30 21:31:44.289084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:44.289000    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" event={"ID":"5550810b-b9ac-4e61-a2de-c00bec116d9f","Type":"ContainerStarted","Data":"1822098a5343beb7aecb72a1e40839392ce10af53fd242f128ae1a99ecec50fa"}
Oct 30 21:31:46.302571 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:46.302532    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" event={"ID":"5550810b-b9ac-4e61-a2de-c00bec116d9f","Type":"ContainerStarted","Data":"82fd27b053301266cba88fddfd3e5b4193b46cfe1dff5fc960dbd43f3352fc55"}
Oct 30 21:31:46.421501 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:46.421451    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podStartSLOduration=1.919635522 podStartE2EDuration="3.421438329s" totalImagesPullingTime="1.501802807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:46.419827504 +0000 UTC m=+507.451676043" watchObservedRunningTime="2026-10-30 21:31:46.421438329 +0000 UTC m=+507.453286864"
Oct 30 21:31:46.563526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:46.563445    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:50.901056 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.901021    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"]
Oct 30 21:31:50.901555 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.901540    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="26ae6455-f4d2-494f-89d8-7692fd1e655a" containerName="cleanup"
Oct 30 21:31:50.905082 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.905058    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:50.917643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.917618    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:50.917744 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.917666    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:50.917786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.917746    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srml8\" (UniqueName: \"kubernetes.io/projected/556b0f73-77d7-4830-a303-e40440b8230b-kube-api-access-srml8\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:50.917833 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.917783    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/556b0f73-77d7-4830-a303-e40440b8230b-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:50.917833 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.917801    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:50.918024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.917928    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:50.957769 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:50.957742    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Oct 30 21:31:51.009800 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.009773    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"]
Oct 30 21:31:51.018742 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.018716    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.018842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.018752    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.018842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.018792    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srml8\" (UniqueName: \"kubernetes.io/projected/556b0f73-77d7-4830-a303-e40440b8230b-kube-api-access-srml8\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.018842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.018838    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/556b0f73-77d7-4830-a303-e40440b8230b-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.018958 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.018863    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.018958 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.018898    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.019207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.019186    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.019258 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.019232    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.019309 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.019295    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.021567 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.021311    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/556b0f73-77d7-4830-a303-e40440b8230b-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.021708 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.021663    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/556b0f73-77d7-4830-a303-e40440b8230b-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.033834 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.033791    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:51.080637 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.080612    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srml8\" (UniqueName: \"kubernetes.io/projected/556b0f73-77d7-4830-a303-e40440b8230b-kube-api-access-srml8\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-8xq9m\" (UID: \"556b0f73-77d7-4830-a303-e40440b8230b\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.217671 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.217608    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:51.595354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:51.595327    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"]
Oct 30 21:31:51.597260 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:31:51.597235    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556b0f73_77d7_4830_a303_e40440b8230b.slice/crio-8349b2db3dd3f7b1406c0ef30266f2896202c369ef260e9ff4c00a4f53304a2a WatchSource:0}: Error finding container 8349b2db3dd3f7b1406c0ef30266f2896202c369ef260e9ff4c00a4f53304a2a: Status 404 returned error can't find the container with id 8349b2db3dd3f7b1406c0ef30266f2896202c369ef260e9ff4c00a4f53304a2a
Oct 30 21:31:52.339894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:52.339864    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m" event={"ID":"556b0f73-77d7-4830-a303-e40440b8230b","Type":"ContainerStarted","Data":"ae45f60978ae4aaf6fd76958acd0bf60f6c7c1afb036b2ded608c0f3084b8240"}
Oct 30 21:31:52.340286 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:52.339927    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m" event={"ID":"556b0f73-77d7-4830-a303-e40440b8230b","Type":"ContainerStarted","Data":"8349b2db3dd3f7b1406c0ef30266f2896202c369ef260e9ff4c00a4f53304a2a"}
Oct 30 21:31:52.457465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:52.457417    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m" podStartSLOduration=1.818794877 podStartE2EDuration="2.457399964s" totalImagesPullingTime="638.605087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:52.456856333 +0000 UTC m=+513.488704868" watchObservedRunningTime="2026-10-30 21:31:52.457399964 +0000 UTC m=+513.489248500"
Oct 30 21:31:53.218487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:53.218451    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:31:53.485121 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:31:53.485031    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:31:53.564343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:53.564310    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:53.577100 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:53.577074    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:54.368905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:54.368875    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:31:55.477460 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.477428    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"]
Oct 30 21:31:55.481336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.481309    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.534715 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.534690    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 30 21:31:55.555547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.555516    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.555703 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.555565    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.555703 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.555627    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f549cab-2622-41f2-a1a6-cde3e9928078-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.555780 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.555743    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.555818 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.555804    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpmvc\" (UniqueName: \"kubernetes.io/projected/8f549cab-2622-41f2-a1a6-cde3e9928078-kube-api-access-qpmvc\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.555872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.555858    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.580563 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.580540    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:55.586621 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.586600    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"]
Oct 30 21:31:55.656806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.656774    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.656806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.656810    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.657034 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.656827    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f549cab-2622-41f2-a1a6-cde3e9928078-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.657034 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.656847    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.657034 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.656885    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpmvc\" (UniqueName: \"kubernetes.io/projected/8f549cab-2622-41f2-a1a6-cde3e9928078-kube-api-access-qpmvc\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.657034 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.656950    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.657293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.657264    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.657368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.657318    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.657368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.657330    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.659304 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.659284    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f549cab-2622-41f2-a1a6-cde3e9928078-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.659582 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.659567    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f549cab-2622-41f2-a1a6-cde3e9928078-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.717889 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.717860    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpmvc\" (UniqueName: \"kubernetes.io/projected/8f549cab-2622-41f2-a1a6-cde3e9928078-kube-api-access-qpmvc\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fdpk7\" (UID: \"8f549cab-2622-41f2-a1a6-cde3e9928078\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:55.794631 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:55.794574    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:56.174403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:56.174379    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"]
Oct 30 21:31:56.176055 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:31:56.176024    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f549cab_2622_41f2_a1a6_cde3e9928078.slice/crio-cce7fbe7cde47a2fafa690cf437554bc5a4327de25bee9fc4c7ae9992e4de02f WatchSource:0}: Error finding container cce7fbe7cde47a2fafa690cf437554bc5a4327de25bee9fc4c7ae9992e4de02f: Status 404 returned error can't find the container with id cce7fbe7cde47a2fafa690cf437554bc5a4327de25bee9fc4c7ae9992e4de02f
Oct 30 21:31:56.368156 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:56.368121    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7" event={"ID":"8f549cab-2622-41f2-a1a6-cde3e9928078","Type":"ContainerStarted","Data":"cce7fbe7cde47a2fafa690cf437554bc5a4327de25bee9fc4c7ae9992e4de02f"}
Oct 30 21:31:57.375188 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:57.375156    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7" event={"ID":"8f549cab-2622-41f2-a1a6-cde3e9928078","Type":"ContainerStarted","Data":"55c3bf9bfda460d7d63c0d634de2b450b0f5bdb00ffaa401aa624cc614476d15"}
Oct 30 21:31:57.493710 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:57.493662    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7" podStartSLOduration=1.920559436 podStartE2EDuration="2.493650549s" totalImagesPullingTime="573.091113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:57.492436615 +0000 UTC m=+518.524285144" watchObservedRunningTime="2026-10-30 21:31:57.493650549 +0000 UTC m=+518.525499083"
Oct 30 21:31:57.795362 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:57.795330    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:31:59.171639 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:31:59.171601    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:01.218743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:01.218710    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:32:01.231661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:01.231639    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:32:01.412705 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:01.412662    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-8xq9m"
Oct 30 21:32:02.324504 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.324474    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"]
Oct 30 21:32:02.328198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.328165    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.420252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.420025    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3acf89da-f35f-4662-bd3d-e2155158f16c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.420252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.420095    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.420252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.420169    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfzcl\" (UniqueName: \"kubernetes.io/projected/3acf89da-f35f-4662-bd3d-e2155158f16c-kube-api-access-kfzcl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.420473 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.420306    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.420473 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.420386    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.420473 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.420416    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.430689 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.430665    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 30 21:32:02.434238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.434216    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:02.434849 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.434821    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"]
Oct 30 21:32:02.521284 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.521253    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.521284 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.521288    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.521519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.521340    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3acf89da-f35f-4662-bd3d-e2155158f16c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.521519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.521385    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.521519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.521411    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfzcl\" (UniqueName: \"kubernetes.io/projected/3acf89da-f35f-4662-bd3d-e2155158f16c-kube-api-access-kfzcl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.521765 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.521735    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.521824 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.521780    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.521878 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.521848    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.522223 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.522196    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.524216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.524186    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3acf89da-f35f-4662-bd3d-e2155158f16c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.524412 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.524388    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3acf89da-f35f-4662-bd3d-e2155158f16c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.583799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.583730    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfzcl\" (UniqueName: \"kubernetes.io/projected/3acf89da-f35f-4662-bd3d-e2155158f16c-kube-api-access-kfzcl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq\" (UID: \"3acf89da-f35f-4662-bd3d-e2155158f16c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:02.645675 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:02.645637    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:03.042312 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:03.042026    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"]
Oct 30 21:32:03.044597 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:32:03.044552    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acf89da_f35f_4662_bd3d_e2155158f16c.slice/crio-68d9058c86e18ad0ef21c64488a9a0a056be2b979937f66cfa856887d839e9c2 WatchSource:0}: Error finding container 68d9058c86e18ad0ef21c64488a9a0a056be2b979937f66cfa856887d839e9c2: Status 404 returned error can't find the container with id 68d9058c86e18ad0ef21c64488a9a0a056be2b979937f66cfa856887d839e9c2
Oct 30 21:32:03.417121 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:03.417076    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq" event={"ID":"3acf89da-f35f-4662-bd3d-e2155158f16c","Type":"ContainerStarted","Data":"68d9058c86e18ad0ef21c64488a9a0a056be2b979937f66cfa856887d839e9c2"}
Oct 30 21:32:04.424281 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:04.424249    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq" event={"ID":"3acf89da-f35f-4662-bd3d-e2155158f16c","Type":"ContainerStarted","Data":"9806165b9f1277fdfc55a976eb6da60611a2c437a8fb24c2dda96e39ac79dad5"}
Oct 30 21:32:04.544643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:04.544584    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq" podStartSLOduration=1.959712956 podStartE2EDuration="2.544567597s" totalImagesPullingTime="584.854641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:32:04.542348396 +0000 UTC m=+525.574196932" watchObservedRunningTime="2026-10-30 21:32:04.544567597 +0000 UTC m=+525.576416132"
Oct 30 21:32:04.645772 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:04.645743    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:05.794839 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:05.794794    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:32:05.807878 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:05.807855    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:32:06.446410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:06.446383    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fdpk7"
Oct 30 21:32:07.149549 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:07.149520    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:12.646741 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:12.646687    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:12.664541 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:12.664515    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:13.492927 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:13.492899    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq"
Oct 30 21:32:23.485865 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:32:23.485827    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:32:25.908273 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:25.908239    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"]
Oct 30 21:32:25.913663 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:25.913646    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.020719 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.020680    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"]
Oct 30 21:32:26.045743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.045710    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.045743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.045743    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.046027 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.045761    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.046027 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.045797    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.046027 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.045930    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.046027 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.045953    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4ssk\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-kube-api-access-m4ssk\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.046273 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.046056    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.046273 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.046082    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.046273 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.046102    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147255 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147226    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147255 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147259    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147513 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147280    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147513 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147478    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147623 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147587    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147686 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147623    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4ssk\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-kube-api-access-m4ssk\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147686 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147656    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147683    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147707    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.147796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.147712    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.148024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.148001    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.148185 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.148161    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.148397 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.148367    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.148896 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.148873    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.150067 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.150044    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.150177 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.150160    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.209617 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.209555    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4ssk\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-kube-api-access-m4ssk\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.209719 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.209631    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-ng58d\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.226450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.226431    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:26.658879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.658852    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"]
Oct 30 21:32:26.660381 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:32:26.660342    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5644e6e_0ed6_41af_8a49_ebfc16dd3923.slice/crio-67f0ecddf69847a3c7c119d6ca47d20bcb82f6e540b42ffb2b370af262103ff7 WatchSource:0}: Error finding container 67f0ecddf69847a3c7c119d6ca47d20bcb82f6e540b42ffb2b370af262103ff7: Status 404 returned error can't find the container with id 67f0ecddf69847a3c7c119d6ca47d20bcb82f6e540b42ffb2b370af262103ff7
Oct 30 21:32:26.662486 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.662456    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:32:26.662584 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.662520    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:32:26.662584 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:26.662550    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:32:27.557987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:27.557931    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" event={"ID":"f5644e6e-0ed6-41af-8a49-ebfc16dd3923","Type":"ContainerStarted","Data":"432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943"}
Oct 30 21:32:27.558423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:27.558020    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" event={"ID":"f5644e6e-0ed6-41af-8a49-ebfc16dd3923","Type":"ContainerStarted","Data":"67f0ecddf69847a3c7c119d6ca47d20bcb82f6e540b42ffb2b370af262103ff7"}
Oct 30 21:32:27.697117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:27.697069    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" podStartSLOduration=2.6970561870000003 podStartE2EDuration="2.697056187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:32:27.695371086 +0000 UTC m=+548.727219621" watchObservedRunningTime="2026-10-30 21:32:27.697056187 +0000 UTC m=+548.728904721"
Oct 30 21:32:28.230993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:28.230324    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:28.232619 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:28.232592    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-ng58d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:32:28.232771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:28.232648    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 21:32:28.632241 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:28.632206    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:29.230995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:29.229382    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-ng58d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:32:29.230995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:29.229447    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 21:32:30.036734 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:30.036669    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:30.231344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:30.231309    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-ng58d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:32:30.231519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:30.231362    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 21:32:31.228533 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.228497    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-ng58d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:32:31.231097 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.231058    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 21:32:31.650895 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.650857    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65bd759848-6rl4v"]
Oct 30 21:32:31.654618 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.654596    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65bd759848-6rl4v"
Oct 30 21:32:31.735551 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.735518    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65bd759848-6rl4v"]
Oct 30 21:32:31.796999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.796953    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gf92\" (UniqueName: \"kubernetes.io/projected/84a98f42-a77d-43cb-a7f9-5ac1d48830f3-kube-api-access-4gf92\") pod \"authorino-65bd759848-6rl4v\" (UID: \"84a98f42-a77d-43cb-a7f9-5ac1d48830f3\") " pod="kuadrant-system/authorino-65bd759848-6rl4v"
Oct 30 21:32:31.797166 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.797018    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84a98f42-a77d-43cb-a7f9-5ac1d48830f3-tls-cert\") pod \"authorino-65bd759848-6rl4v\" (UID: \"84a98f42-a77d-43cb-a7f9-5ac1d48830f3\") " pod="kuadrant-system/authorino-65bd759848-6rl4v"
Oct 30 21:32:31.831860 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.831824    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:31.898669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.898637    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gf92\" (UniqueName: \"kubernetes.io/projected/84a98f42-a77d-43cb-a7f9-5ac1d48830f3-kube-api-access-4gf92\") pod \"authorino-65bd759848-6rl4v\" (UID: \"84a98f42-a77d-43cb-a7f9-5ac1d48830f3\") " pod="kuadrant-system/authorino-65bd759848-6rl4v"
Oct 30 21:32:31.898837 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.898683    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84a98f42-a77d-43cb-a7f9-5ac1d48830f3-tls-cert\") pod \"authorino-65bd759848-6rl4v\" (UID: \"84a98f42-a77d-43cb-a7f9-5ac1d48830f3\") " pod="kuadrant-system/authorino-65bd759848-6rl4v"
Oct 30 21:32:31.901686 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.901626    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84a98f42-a77d-43cb-a7f9-5ac1d48830f3-tls-cert\") pod \"authorino-65bd759848-6rl4v\" (UID: \"84a98f42-a77d-43cb-a7f9-5ac1d48830f3\") " pod="kuadrant-system/authorino-65bd759848-6rl4v"
Oct 30 21:32:31.964533 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.964499    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gf92\" (UniqueName: \"kubernetes.io/projected/84a98f42-a77d-43cb-a7f9-5ac1d48830f3-kube-api-access-4gf92\") pod \"authorino-65bd759848-6rl4v\" (UID: \"84a98f42-a77d-43cb-a7f9-5ac1d48830f3\") " pod="kuadrant-system/authorino-65bd759848-6rl4v"
Oct 30 21:32:31.966502 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.966478    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65bd759848-6rl4v"
Oct 30 21:32:31.995611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:31.995579    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:32.228786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:32.228284    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-ng58d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:32:32.228786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:32.228344    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 21:32:32.366901 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:32.366876    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65bd759848-6rl4v"]
Oct 30 21:32:32.367889 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:32:32.367864    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84a98f42_a77d_43cb_a7f9_5ac1d48830f3.slice/crio-2538876a19b41ce5a4aa482eb851b1c9b54617c725f12607f58da969ba837ab0 WatchSource:0}: Error finding container 2538876a19b41ce5a4aa482eb851b1c9b54617c725f12607f58da969ba837ab0: Status 404 returned error can't find the container with id 2538876a19b41ce5a4aa482eb851b1c9b54617c725f12607f58da969ba837ab0
Oct 30 21:32:32.589164 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:32.589081    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65bd759848-6rl4v" event={"ID":"84a98f42-a77d-43cb-a7f9-5ac1d48830f3","Type":"ContainerStarted","Data":"2538876a19b41ce5a4aa482eb851b1c9b54617c725f12607f58da969ba837ab0"}
Oct 30 21:32:33.227519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:33.227484    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-ng58d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:32:33.227690 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:33.227548    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 21:32:34.601737 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:34.601691    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65bd759848-6rl4v" event={"ID":"84a98f42-a77d-43cb-a7f9-5ac1d48830f3","Type":"ContainerStarted","Data":"bd684577c32f20693ca36bbc276b2202be65e21a96459d14668f26a7ef0e211f"}
Oct 30 21:32:34.718489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:34.718428    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-65bd759848-6rl4v" podStartSLOduration=2.002581072 podStartE2EDuration="3.718409954s" totalImagesPullingTime="1.715828882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:32:34.717336541 +0000 UTC m=+555.749185077" watchObservedRunningTime="2026-10-30 21:32:34.718409954 +0000 UTC m=+555.750258482"
Oct 30 21:32:34.790306 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:34.778261    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58d5d6454c-9m58t"]
Oct 30 21:32:34.790306 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:34.778495    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-58d5d6454c-9m58t" podUID="feb3d94f-b066-42fc-9812-dfe5e5097d24" containerName="authorino" containerID="cri-o://1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5" gracePeriod=30
Oct 30 21:32:34.905072 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:34.903924    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:34.905429 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:34.905389    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:34.906342 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:34.906321    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 21:32:35.031942 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.031919    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:32:35.136082 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.136047    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/feb3d94f-b066-42fc-9812-dfe5e5097d24-kube-api-access-4lq78\" (UniqueName: \"kubernetes.io/projected/feb3d94f-b066-42fc-9812-dfe5e5097d24-kube-api-access-4lq78\") pod \"feb3d94f-b066-42fc-9812-dfe5e5097d24\" (UID: \"feb3d94f-b066-42fc-9812-dfe5e5097d24\") "
Oct 30 21:32:35.136237 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.136145    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/feb3d94f-b066-42fc-9812-dfe5e5097d24-tls-cert\" (UniqueName: \"kubernetes.io/secret/feb3d94f-b066-42fc-9812-dfe5e5097d24-tls-cert\") pod \"feb3d94f-b066-42fc-9812-dfe5e5097d24\" (UID: \"feb3d94f-b066-42fc-9812-dfe5e5097d24\") "
Oct 30 21:32:35.138334 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.138305    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb3d94f-b066-42fc-9812-dfe5e5097d24-kube-api-access-4lq78" pod "feb3d94f-b066-42fc-9812-dfe5e5097d24" (UID: "feb3d94f-b066-42fc-9812-dfe5e5097d24"). InnerVolumeSpecName "kube-api-access-4lq78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:35.147798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.147744    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb3d94f-b066-42fc-9812-dfe5e5097d24-tls-cert" pod "feb3d94f-b066-42fc-9812-dfe5e5097d24" (UID: "feb3d94f-b066-42fc-9812-dfe5e5097d24"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:35.237612 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.237578    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lq78\" (UniqueName: \"kubernetes.io/projected/feb3d94f-b066-42fc-9812-dfe5e5097d24-kube-api-access-4lq78\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:35.237612 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.237608    5575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/feb3d94f-b066-42fc-9812-dfe5e5097d24-tls-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:35.609167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.609081    5575 generic.go:356] "Generic (PLEG): container finished" podID="feb3d94f-b066-42fc-9812-dfe5e5097d24" containerID="1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5" exitCode=0
Oct 30 21:32:35.609167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.609128    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58d5d6454c-9m58t"
Oct 30 21:32:35.609602 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.609164    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58d5d6454c-9m58t" event={"ID":"feb3d94f-b066-42fc-9812-dfe5e5097d24","Type":"ContainerDied","Data":"1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5"}
Oct 30 21:32:35.609602 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.609210    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58d5d6454c-9m58t" event={"ID":"feb3d94f-b066-42fc-9812-dfe5e5097d24","Type":"ContainerDied","Data":"3045a2d702f219509fca9bd13df8cb1310f020ecb4618153074fc9267af9e5f0"}
Oct 30 21:32:35.609602 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.609233    5575 scope.go:122] "RemoveContainer" containerID="1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5"
Oct 30 21:32:35.618663 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.618643    5575 scope.go:122] "RemoveContainer" containerID="1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5"
Oct 30 21:32:35.618931 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:32:35.618913    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5\": container with ID starting with 1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5 not found: ID does not exist" containerID="1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5"
Oct 30 21:32:35.619029 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.618941    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5"} err="failed to get container status \"1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5\": rpc error: code = NotFound desc = could not find container \"1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5\": container with ID starting with 1f414a8d4448e081b5baaf59a50b644267414ee1701a7b58f807912870ba8cd5 not found: ID does not exist"
Oct 30 21:32:35.776932 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.776896    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58d5d6454c-9m58t"]
Oct 30 21:32:35.779600 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:35.779576    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58d5d6454c-9m58t"]
Oct 30 21:32:37.130998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:37.127331    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="feb3d94f-b066-42fc-9812-dfe5e5097d24" path="/var/lib/kubelet/pods/feb3d94f-b066-42fc-9812-dfe5e5097d24/volumes"
Oct 30 21:32:41.671989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:41.671940    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:41.858121 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:41.858086    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:42.241595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.241551    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-bqfjc"]
Oct 30 21:32:42.242171 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.242147    5575 cpu_manager.go:414] "containerMap: removing container" podUID="feb3d94f-b066-42fc-9812-dfe5e5097d24" containerName="authorino"
Oct 30 21:32:42.242171 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.242168    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="feb3d94f-b066-42fc-9812-dfe5e5097d24" containerName="authorino"
Oct 30 21:32:42.242391 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.242308    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="feb3d94f-b066-42fc-9812-dfe5e5097d24" containerName="authorino"
Oct 30 21:32:42.247246 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.247222    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:32:42.300585 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.300533    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Oct 30 21:32:42.350692 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.350657    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g8zp7\""
Oct 30 21:32:42.353243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.353218    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-bqfjc"]
Oct 30 21:32:42.422347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.422309    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7pmm\" (UniqueName: \"kubernetes.io/projected/248fa973-af6e-4765-8524-dcebe743bda6-kube-api-access-h7pmm\") pod \"payload-processing-5f78687d5b-bqfjc\" (UID: \"248fa973-af6e-4765-8524-dcebe743bda6\") " pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:32:42.422494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.422361    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/248fa973-af6e-4765-8524-dcebe743bda6-plugins-config-volume\") pod \"payload-processing-5f78687d5b-bqfjc\" (UID: \"248fa973-af6e-4765-8524-dcebe743bda6\") " pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:32:42.523456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.523380    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7pmm\" (UniqueName: \"kubernetes.io/projected/248fa973-af6e-4765-8524-dcebe743bda6-kube-api-access-h7pmm\") pod \"payload-processing-5f78687d5b-bqfjc\" (UID: \"248fa973-af6e-4765-8524-dcebe743bda6\") " pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:32:42.523456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.523423    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/248fa973-af6e-4765-8524-dcebe743bda6-plugins-config-volume\") pod \"payload-processing-5f78687d5b-bqfjc\" (UID: \"248fa973-af6e-4765-8524-dcebe743bda6\") " pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:32:42.524121 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.524098    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/248fa973-af6e-4765-8524-dcebe743bda6-plugins-config-volume\") pod \"payload-processing-5f78687d5b-bqfjc\" (UID: \"248fa973-af6e-4765-8524-dcebe743bda6\") " pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:32:42.585117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.585087    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7pmm\" (UniqueName: \"kubernetes.io/projected/248fa973-af6e-4765-8524-dcebe743bda6-kube-api-access-h7pmm\") pod \"payload-processing-5f78687d5b-bqfjc\" (UID: \"248fa973-af6e-4765-8524-dcebe743bda6\") " pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:32:42.861614 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:42.861531    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:32:43.244331 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:43.244302    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-bqfjc"]
Oct 30 21:32:43.246757 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:32:43.246727    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248fa973_af6e_4765_8524_dcebe743bda6.slice/crio-4eae72fd74d2fa0ef4574f6ed93e0d833479d25170e288b578b09eaf726848a6 WatchSource:0}: Error finding container 4eae72fd74d2fa0ef4574f6ed93e0d833479d25170e288b578b09eaf726848a6: Status 404 returned error can't find the container with id 4eae72fd74d2fa0ef4574f6ed93e0d833479d25170e288b578b09eaf726848a6
Oct 30 21:32:43.464738 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:43.464699    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:43.685773 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:43.685740    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc" event={"ID":"248fa973-af6e-4765-8524-dcebe743bda6","Type":"ContainerStarted","Data":"4eae72fd74d2fa0ef4574f6ed93e0d833479d25170e288b578b09eaf726848a6"}
Oct 30 21:32:46.704027 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:46.703991    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc" event={"ID":"248fa973-af6e-4765-8524-dcebe743bda6","Type":"ContainerStarted","Data":"63ab3aaabe660ce8a60b04f3b6aaeaf600debb6149f54af6b9bae5f48d8c7e29"}
Oct 30 21:32:46.704505 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:46.704098    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:32:46.821607 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:46.821564    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc" podStartSLOduration=2.20628627 podStartE2EDuration="4.821550574s" totalImagesPullingTime="2.615264304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:32:46.820462587 +0000 UTC m=+567.852311122" watchObservedRunningTime="2026-10-30 21:32:46.821550574 +0000 UTC m=+567.853399108"
Oct 30 21:32:53.485895 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:32:53.485859    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:32:57.719632 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:32:57.719596    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-bqfjc"
Oct 30 21:33:05.818071 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:05.818040    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:06.308214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:06.308186    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:17.939117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:17.939081    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:18.103190 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:18.103155    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:19.186422 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:19.186390    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:33:19.192078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:19.192051    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:33:19.203523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:19.203504    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:33:19.208758 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:19.208741    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:33:23.486122 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:33:23.486090    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:33:29.633415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:29.633384    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:29.886417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:29.886340    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:43.801189 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:43.801151    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:47.477985 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:33:47.477930    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:53.485361 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:33:53.485327    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:34:15.936286 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:15.936253    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:16.103497 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.103458    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:16.494225 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.494192    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"]
Oct 30 21:34:16.497657 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.497629    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.550120 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.550089    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-1de75a-openshift-default-dockercfg-rtvkc\""
Oct 30 21:34:16.602568 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.602537    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"]
Oct 30 21:34:16.607949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.607925    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:16.639914 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.639883    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.640085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.639928    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-credential-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.640085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.639949    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-data\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.640085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.640056    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istiod-ca-cert\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.640201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.640092    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-certs\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.640201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.640109    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-envoy\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.640201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.640138    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thblw\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-kube-api-access-thblw\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.640316 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.640237    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-podinfo\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.640316 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.640277    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-token\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.741651 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.741607    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-token\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.741846 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.741661    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.741846 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.741692    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-credential-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.741846 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.741712    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-data\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742073 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.741882    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istiod-ca-cert\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742073 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.741980    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-certs\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742073 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.742056    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-envoy\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742239 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.742107    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thblw\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-kube-api-access-thblw\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742239 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.742176    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-data\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742239 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.742188    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-podinfo\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742239 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.742219    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742421 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.742291    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-certs\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742516 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.742495    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-credential-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.742777 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.742711    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istiod-ca-cert\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.744994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.744890    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-envoy\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.745262 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.745233    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-podinfo\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.776496 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.776466    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:16.803083 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.803061    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-token\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.806439 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.806419    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thblw\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-kube-api-access-thblw\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.813293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.813270    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:16.930023 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:16.929994    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:17.144626 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.144586    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"]
Oct 30 21:34:17.149230 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.149209    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.209902 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.209866    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-69e4b2-openshift-default-dockercfg-qvwv2\""
Oct 30 21:34:17.244716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.244679    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"]
Oct 30 21:34:17.248376 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.248345    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.248376 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.248375    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlz8f\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-kube-api-access-mlz8f\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.248570 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.248486    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.248570 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.248528    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.248570 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.248559    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.248715 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.248680    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c98795-1764-46b9-a95f-c084ef7f32c5-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.248817 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.248793    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.248876 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.248860    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.249041 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.249010    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.288162 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.286182    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"]
Oct 30 21:34:17.291949 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:34:17.291920    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2acbf1_7aa1_41ec_ba84_7338e4ebc6d2.slice/crio-de50e3fd0238a79c8e31c47fb74639eb4507e6681d5190ebca0ec9e1fdaf3b5e WatchSource:0}: Error finding container de50e3fd0238a79c8e31c47fb74639eb4507e6681d5190ebca0ec9e1fdaf3b5e: Status 404 returned error can't find the container with id de50e3fd0238a79c8e31c47fb74639eb4507e6681d5190ebca0ec9e1fdaf3b5e
Oct 30 21:34:17.294850 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.294809    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:17.295054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.295028    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:17.295226 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.295077    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:17.327291 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.327266    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:17.350207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350181    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350273 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350231    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350352    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlz8f\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-kube-api-access-mlz8f\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350443 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350426    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350463    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350557 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350495    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350662 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350549    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c98795-1764-46b9-a95f-c084ef7f32c5-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350662 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350575    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350662 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350630    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350820 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350685    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.350929 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.350895    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.351085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.351043    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.351299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.351282    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c98795-1764-46b9-a95f-c084ef7f32c5-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.351355 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.351332    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.352664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.352647    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.353368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.353351    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.425219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.425146    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.425820 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.425795    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlz8f\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-kube-api-access-mlz8f\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.462356 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.462333    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:17.496510 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.496479    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:17.505826 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.505796    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"]
Oct 30 21:34:17.510945 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.510925    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.563424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.563388    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-d68156-openshift-default-dockercfg-wslcg\""
Oct 30 21:34:17.570739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.570711    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"]
Oct 30 21:34:17.654036 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.653995    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b82ht\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-kube-api-access-b82ht\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.654437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.654410    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.654639 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.654616    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-podinfo\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.654778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.654659    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-certs\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.654778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.654683    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9f5642-220c-44e0-99be-5151a484e3d3-istiod-ca-cert\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.654778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.654727    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-envoy\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.654945 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.654777    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-data\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.654945 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.654802    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-token\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.654945 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.654873    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-credential-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.661172 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.661147    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:17.756255 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756189    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-podinfo\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.756255 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756224    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-certs\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.756255 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756243    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9f5642-220c-44e0-99be-5151a484e3d3-istiod-ca-cert\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.756476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756386    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-envoy\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.756476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756453    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-data\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.756578 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756478    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-token\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.756578 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756554    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-credential-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.756692 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756632    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82ht\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-kube-api-access-b82ht\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.756692 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756670    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-certs\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.756797 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756671    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.757016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.756991    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.757114 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.757076    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-data\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.757114 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.757104    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-credential-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.757276 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.757249    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9f5642-220c-44e0-99be-5151a484e3d3-istiod-ca-cert\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.759046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.759025    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-envoy\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.759153 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.759061    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-podinfo\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.820537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.820510    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b82ht\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-kube-api-access-b82ht\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.820712 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.820693    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-token\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.825594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.825573    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:17.847322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.847295    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:17.855437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.855407    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"]
Oct 30 21:34:17.865993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.864899    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:17.865993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.865006    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:17.865993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:17.865059    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:18.003618 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.003527    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:18.173618 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.173584    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:18.221282 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.221233    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" event={"ID":"d5c98795-1764-46b9-a95f-c084ef7f32c5","Type":"ContainerStarted","Data":"5e65dba98d5b434c6de340ecb4ddd3daf57247afa46ba802e327c9781bd07803"}
Oct 30 21:34:18.221471 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.221298    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" event={"ID":"d5c98795-1764-46b9-a95f-c084ef7f32c5","Type":"ContainerStarted","Data":"3b3e22d624e8ecbf106a07812b4944359211af8b94c6b40037711ed5e0b29790"}
Oct 30 21:34:18.223113 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.223083    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" event={"ID":"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2","Type":"ContainerStarted","Data":"10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda"}
Oct 30 21:34:18.223245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.223129    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" event={"ID":"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2","Type":"ContainerStarted","Data":"de50e3fd0238a79c8e31c47fb74639eb4507e6681d5190ebca0ec9e1fdaf3b5e"}
Oct 30 21:34:18.236434 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:34:18.236405    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9f5642_220c_44e0_99be_5151a484e3d3.slice/crio-9839e4abe719b9dd320a566963ec730b5bcedf9441b8e5ddc0c71070951acdbb WatchSource:0}: Error finding container 9839e4abe719b9dd320a566963ec730b5bcedf9441b8e5ddc0c71070951acdbb: Status 404 returned error can't find the container with id 9839e4abe719b9dd320a566963ec730b5bcedf9441b8e5ddc0c71070951acdbb
Oct 30 21:34:18.236434 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.236407    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"]
Oct 30 21:34:18.238794 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.238761    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:18.238882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.238839    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:18.238921 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.238884    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:18.325330 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.325292    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:18.342890 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.342830    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" podStartSLOduration=1.342813279 podStartE2EDuration="1.342813279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:18.341630593 +0000 UTC m=+659.373479141" watchObservedRunningTime="2026-10-30 21:34:18.342813279 +0000 UTC m=+659.374661818"
Oct 30 21:34:18.469591 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.469458    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:18.476874 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.476849    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:18.482489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.482453    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:18.599666 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.599598    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podStartSLOduration=2.599582319 podStartE2EDuration="2.599582319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:18.46923954 +0000 UTC m=+659.501088067" watchObservedRunningTime="2026-10-30 21:34:18.599582319 +0000 UTC m=+659.631430853"
Oct 30 21:34:18.814304 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.814234    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:18.819497 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:18.819472    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:19.232184 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:19.232151    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" event={"ID":"fb9f5642-220c-44e0-99be-5151a484e3d3","Type":"ContainerStarted","Data":"b0792d67b115172dd68ae3769f5194c52af13bb02c8f8c6ffdac3f3e2b779e74"}
Oct 30 21:34:19.232633 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:19.232211    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" event={"ID":"fb9f5642-220c-44e0-99be-5151a484e3d3","Type":"ContainerStarted","Data":"9839e4abe719b9dd320a566963ec730b5bcedf9441b8e5ddc0c71070951acdbb"}
Oct 30 21:34:19.232749 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:19.232727    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:19.232793 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:19.232777    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:19.233606 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:19.233586    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:19.233723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:19.233634    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:34:19.357161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:19.357112    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" podStartSLOduration=2.357099163 podStartE2EDuration="2.357099163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:19.355074826 +0000 UTC m=+660.386923362" watchObservedRunningTime="2026-10-30 21:34:19.357099163 +0000 UTC m=+660.388947697"
Oct 30 21:34:19.826576 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:19.826543    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:19.834649 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:19.834622    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:20.238105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:20.238078    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:20.239107 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:20.239088    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:21.474721 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:21.474671    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:21.656074 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:21.656042    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:21.810810 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:21.810697    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:22.327811 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:22.327775    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:22.526024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:22.525984    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:22.686155 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:22.686120    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:23.485606 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:34:23.485575    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:34:24.206146 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:24.206089    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:24.419764 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:24.419717    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:24.654199 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:24.654167    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:24.873327 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:24.873285    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:25.028743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.028650    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:25.179411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.179382    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"]
Oct 30 21:34:25.184499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.184480    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:25.238689 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.238658    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5mqv\" (UniqueName: \"kubernetes.io/projected/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-kube-api-access-z5mqv\") pod \"payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs\" (UID: \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:25.239137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.238787    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs\" (UID: \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:25.242586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.242565    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"]
Oct 30 21:34:25.294286 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.294175    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-1de75a\""
Oct 30 21:34:25.295303 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.295283    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-1de75a-dockercfg-n5bpx\""
Oct 30 21:34:25.339560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.339528    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs\" (UID: \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:25.339752 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.339591    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5mqv\" (UniqueName: \"kubernetes.io/projected/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-kube-api-access-z5mqv\") pod \"payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs\" (UID: \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:25.340312 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.340289    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs\" (UID: \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:25.401481 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.401436    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5mqv\" (UniqueName: \"kubernetes.io/projected/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-kube-api-access-z5mqv\") pod \"payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs\" (UID: \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:25.497262 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.497234    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:25.872941 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:25.872916    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"]
Oct 30 21:34:25.874573 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:34:25.874546    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e5cb43_78bd_49b5_aabf_fda9c2bdee80.slice/crio-216de39294e18edabf36205b562c496d97ac5afbf1a6bd6189ea080ed659aa42 WatchSource:0}: Error finding container 216de39294e18edabf36205b562c496d97ac5afbf1a6bd6189ea080ed659aa42: Status 404 returned error can't find the container with id 216de39294e18edabf36205b562c496d97ac5afbf1a6bd6189ea080ed659aa42
Oct 30 21:34:26.304260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.304225    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs" event={"ID":"59e5cb43-78bd-49b5-aabf-fda9c2bdee80","Type":"ContainerStarted","Data":"99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b"}
Oct 30 21:34:26.304637 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.304289    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:26.304637 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.304328    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs" event={"ID":"59e5cb43-78bd-49b5-aabf-fda9c2bdee80","Type":"ContainerStarted","Data":"216de39294e18edabf36205b562c496d97ac5afbf1a6bd6189ea080ed659aa42"}
Oct 30 21:34:26.422350 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.422299    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs" podStartSLOduration=1.4222851699999999 podStartE2EDuration="1.42228517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:26.419573683 +0000 UTC m=+667.451422221" watchObservedRunningTime="2026-10-30 21:34:26.42228517 +0000 UTC m=+667.454133705"
Oct 30 21:34:26.531437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.531403    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"]
Oct 30 21:34:26.535079 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.535062    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.549357 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.549326    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.549491 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.549401    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.549491 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.549461    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.549609 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.549493    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.549609 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.549542    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.549609 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.549575    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.549760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.549628    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqq5h\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-kube-api-access-qqq5h\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.549760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.549658    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.549760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.549680    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.587782 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.587714    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-91874e-openshift-default-dockercfg-zjpd2\""
Oct 30 21:34:26.615475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.615445    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:26.615862 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.615842    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"]
Oct 30 21:34:26.650404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650378    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650522 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650418    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650522 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650479    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqq5h\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-kube-api-access-qqq5h\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650522 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650511    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650538    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650576    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650653    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650808 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650679    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650808 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650722    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650914 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650848    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.650999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.650926    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.651114 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.651091    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.651248 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.651222    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.651312 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.651270    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.653204 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.653184    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.653282 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.653253    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.715519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.715488    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.715681 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.715661    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqq5h\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-kube-api-access-qqq5h\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:26.790546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.790514    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:26.848665 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:26.848588    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:27.277596 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:27.277575    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"]
Oct 30 21:34:27.278947 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:34:27.278921    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641eaa1c_eaf0_4988_a1f2_b8d7f8583a50.slice/crio-6d4f39fc4921661a6fb4dc9360fb38ad20a95012d3f968feafbfe89362a9884d WatchSource:0}: Error finding container 6d4f39fc4921661a6fb4dc9360fb38ad20a95012d3f968feafbfe89362a9884d: Status 404 returned error can't find the container with id 6d4f39fc4921661a6fb4dc9360fb38ad20a95012d3f968feafbfe89362a9884d
Oct 30 21:34:27.281167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:27.281134    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:27.281267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:27.281196    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:27.281267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:27.281225    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:27.317118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:27.317081    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" event={"ID":"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50","Type":"ContainerStarted","Data":"6d4f39fc4921661a6fb4dc9360fb38ad20a95012d3f968feafbfe89362a9884d"}
Oct 30 21:34:28.144289 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:28.144258    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:28.305771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:28.305742    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:28.324388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:28.324361    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" event={"ID":"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50","Type":"ContainerStarted","Data":"1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef"}
Oct 30 21:34:28.446858 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:28.446751    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" podStartSLOduration=2.446732928 podStartE2EDuration="2.446732928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:28.443956997 +0000 UTC m=+669.475805537" watchObservedRunningTime="2026-10-30 21:34:28.446732928 +0000 UTC m=+669.478581465"
Oct 30 21:34:28.460496 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:28.460462    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:28.849112 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:28.849019    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:28.854456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:28.854427    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:29.330902 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:29.330871    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:29.331718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:29.331699    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:34:29.665191 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:29.665156    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:29.845101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:29.845069    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:30.071713 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.071631    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"]
Oct 30 21:34:30.075276 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.075260    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:30.131025 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.130999    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-c7d477\""
Oct 30 21:34:30.131157 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.131137    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-c7d477-dockercfg-9g42s\""
Oct 30 21:34:30.134187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.134167    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"]
Oct 30 21:34:30.190266 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.190220    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feee97c2-4c34-47a5-a42b-92c0d86fd649-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97\" (UID: \"feee97c2-4c34-47a5-a42b-92c0d86fd649\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:30.190625 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.190393    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdsrt\" (UniqueName: \"kubernetes.io/projected/feee97c2-4c34-47a5-a42b-92c0d86fd649-kube-api-access-bdsrt\") pod \"payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97\" (UID: \"feee97c2-4c34-47a5-a42b-92c0d86fd649\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:30.223922 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.223879    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"]
Oct 30 21:34:30.228016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.227950    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:30.282857 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.282826    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"]
Oct 30 21:34:30.291739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.291715    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4640d4b0-8d38-43a1-8be8-085fb6384972-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6\" (UID: \"4640d4b0-8d38-43a1-8be8-085fb6384972\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:30.291895 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.291768    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs5bp\" (UniqueName: \"kubernetes.io/projected/4640d4b0-8d38-43a1-8be8-085fb6384972-kube-api-access-rs5bp\") pod \"payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6\" (UID: \"4640d4b0-8d38-43a1-8be8-085fb6384972\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:30.292005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.291977    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdsrt\" (UniqueName: \"kubernetes.io/projected/feee97c2-4c34-47a5-a42b-92c0d86fd649-kube-api-access-bdsrt\") pod \"payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97\" (UID: \"feee97c2-4c34-47a5-a42b-92c0d86fd649\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:30.292150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.292067    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feee97c2-4c34-47a5-a42b-92c0d86fd649-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97\" (UID: \"feee97c2-4c34-47a5-a42b-92c0d86fd649\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:30.292982 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.292947    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feee97c2-4c34-47a5-a42b-92c0d86fd649-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97\" (UID: \"feee97c2-4c34-47a5-a42b-92c0d86fd649\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:30.354273 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.354208    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdsrt\" (UniqueName: \"kubernetes.io/projected/feee97c2-4c34-47a5-a42b-92c0d86fd649-kube-api-access-bdsrt\") pod \"payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97\" (UID: \"feee97c2-4c34-47a5-a42b-92c0d86fd649\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:30.389153 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.389126    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:30.393611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.393586    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4640d4b0-8d38-43a1-8be8-085fb6384972-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6\" (UID: \"4640d4b0-8d38-43a1-8be8-085fb6384972\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:30.393700 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.393673    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs5bp\" (UniqueName: \"kubernetes.io/projected/4640d4b0-8d38-43a1-8be8-085fb6384972-kube-api-access-rs5bp\") pod \"payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6\" (UID: \"4640d4b0-8d38-43a1-8be8-085fb6384972\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:30.394290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.394270    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4640d4b0-8d38-43a1-8be8-085fb6384972-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6\" (UID: \"4640d4b0-8d38-43a1-8be8-085fb6384972\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:30.461003 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.455439    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs5bp\" (UniqueName: \"kubernetes.io/projected/4640d4b0-8d38-43a1-8be8-085fb6384972-kube-api-access-rs5bp\") pod \"payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6\" (UID: \"4640d4b0-8d38-43a1-8be8-085fb6384972\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:30.542011 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.541959    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:30.768441 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.768419    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"]
Oct 30 21:34:30.769876 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:34:30.769842    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeee97c2_4c34_47a5_a42b_92c0d86fd649.slice/crio-514e57888e4b48c8d8cc1e6acf3f69263e757fbcecee460fe9f6ad629ee4a5fe WatchSource:0}: Error finding container 514e57888e4b48c8d8cc1e6acf3f69263e757fbcecee460fe9f6ad629ee4a5fe: Status 404 returned error can't find the container with id 514e57888e4b48c8d8cc1e6acf3f69263e757fbcecee460fe9f6ad629ee4a5fe
Oct 30 21:34:30.923847 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:30.923821    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"]
Oct 30 21:34:30.925159 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:34:30.925128    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4640d4b0_8d38_43a1_8be8_085fb6384972.slice/crio-d54c426521bfa619282b16f33a0a3db141201c0256a3cbe2d2accea6f1277b71 WatchSource:0}: Error finding container d54c426521bfa619282b16f33a0a3db141201c0256a3cbe2d2accea6f1277b71: Status 404 returned error can't find the container with id d54c426521bfa619282b16f33a0a3db141201c0256a3cbe2d2accea6f1277b71
Oct 30 21:34:31.345026 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:31.344982    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6" event={"ID":"4640d4b0-8d38-43a1-8be8-085fb6384972","Type":"ContainerStarted","Data":"0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e"}
Oct 30 21:34:31.345183 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:31.345070    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:31.345183 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:31.345090    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6" event={"ID":"4640d4b0-8d38-43a1-8be8-085fb6384972","Type":"ContainerStarted","Data":"d54c426521bfa619282b16f33a0a3db141201c0256a3cbe2d2accea6f1277b71"}
Oct 30 21:34:31.346720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:31.346694    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97" event={"ID":"feee97c2-4c34-47a5-a42b-92c0d86fd649","Type":"ContainerStarted","Data":"a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9"}
Oct 30 21:34:31.346816 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:31.346741    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97" event={"ID":"feee97c2-4c34-47a5-a42b-92c0d86fd649","Type":"ContainerStarted","Data":"514e57888e4b48c8d8cc1e6acf3f69263e757fbcecee460fe9f6ad629ee4a5fe"}
Oct 30 21:34:31.346856 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:31.346836    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:31.462790 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:31.462724    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6" podStartSLOduration=1.462711621 podStartE2EDuration="1.462711621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:31.460342051 +0000 UTC m=+672.492190598" watchObservedRunningTime="2026-10-30 21:34:31.462711621 +0000 UTC m=+672.494560156"
Oct 30 21:34:31.581314 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:31.580099    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97" podStartSLOduration=1.58007792 podStartE2EDuration="1.58007792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:31.578587522 +0000 UTC m=+672.610436052" watchObservedRunningTime="2026-10-30 21:34:31.58007792 +0000 UTC m=+672.611926457"
Oct 30 21:34:32.008977 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:32.008934    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:32.264789 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:32.264718    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:32.455757 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:32.455721    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:32.620172 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:32.620086    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:33.555950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:33.555915    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:33.713469 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:33.713437    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:33.941912 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:33.941881    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:34.243172 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:34.243084    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:34.404158 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:34.404112    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:34.574895 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:34.574783    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:37.320563 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:37.320537    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 21:34:38.812104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:38.812069    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:38.971380 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:38.971336    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:39.177570 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:39.177532    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:42.055598 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:42.055472    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:42.212951 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:42.212855    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:42.367801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:42.367706    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 21:34:42.369235 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:42.369202    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 21:34:42.586992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:42.586660    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:42.770175 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:42.770128    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:42.944991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:42.937248    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:44.166371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:44.166324    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:44.326732 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:44.326600    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:44.545047 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:44.529401    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:44.779057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:44.779027    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:49.230437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.230397    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"]
Oct 30 21:34:49.235529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.235500    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.293024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.292996    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"]
Oct 30 21:34:49.338647 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.338539    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 21:34:49.338647 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.338569    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-69e4b2-serving-cert\""
Oct 30 21:34:49.339303 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.339282    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k79xr\""
Oct 30 21:34:49.354212 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.354169    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhl8l\" (UniqueName: \"kubernetes.io/projected/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-kube-api-access-mhl8l\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.354557 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.354534    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.354806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.354785    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.355105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.355087    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-metrics-certs\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.433564 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.433520    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:49.455857 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.455821    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhl8l\" (UniqueName: \"kubernetes.io/projected/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-kube-api-access-mhl8l\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.456046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.455898    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.456109 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.455958    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.456166 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.456135    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-metrics-certs\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.456343 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:34:49.456318    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-serving-cert: secret "maas-api-e2e-worker-w6-69e4b2-serving-cert" not found
Oct 30 21:34:49.456428 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:34:49.456420    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls podName:7b8d46bd-7815-4c9b-b3bf-a88121558e3a nodeName:}" failed. No retries permitted until 2026-10-30 21:34:49.956397144 +0000 UTC m=+690.988245681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls") pod "maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56" (UID: "7b8d46bd-7815-4c9b-b3bf-a88121558e3a") : secret "maas-api-e2e-worker-w6-69e4b2-serving-cert" not found
Oct 30 21:34:49.457279 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.457250    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.460234 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.460187    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-metrics-certs\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.519780 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.519694    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhl8l\" (UniqueName: \"kubernetes.io/projected/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-kube-api-access-mhl8l\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.640487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.640445    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:49.810277 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.810186    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:49.961949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.961909    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:49.964733 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:49.964706    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:50.155130 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:50.155092    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:50.275178 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:50.275136    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:34:50.275664 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:50.275220    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:34:50.538495 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:50.538466    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"]
Oct 30 21:34:50.539664 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:34:50.539631    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8d46bd_7815_4c9b_b3bf_a88121558e3a.slice/crio-04a71edb4232e09fee953de4e12216dcbab25abec269d45c41236de7f8cea88d WatchSource:0}: Error finding container 04a71edb4232e09fee953de4e12216dcbab25abec269d45c41236de7f8cea88d: Status 404 returned error can't find the container with id 04a71edb4232e09fee953de4e12216dcbab25abec269d45c41236de7f8cea88d
Oct 30 21:34:50.541030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:50.541015    5575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:34:50.894592 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:50.894563    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:48912->10.132.0.65:15021: read: connection reset by peer" start-of-body=
Oct 30 21:34:50.894773 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:50.894626    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:48912->10.132.0.65:15021: read: connection reset by peer"
Oct 30 21:34:51.525307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.525267    5575 generic.go:356] "Generic (PLEG): container finished" podID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerID="b0792d67b115172dd68ae3769f5194c52af13bb02c8f8c6ffdac3f3e2b779e74" exitCode=0
Oct 30 21:34:51.525798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.525335    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" event={"ID":"fb9f5642-220c-44e0-99be-5151a484e3d3","Type":"ContainerDied","Data":"b0792d67b115172dd68ae3769f5194c52af13bb02c8f8c6ffdac3f3e2b779e74"}
Oct 30 21:34:51.525798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.525760    5575 scope.go:122] "RemoveContainer" containerID="b0792d67b115172dd68ae3769f5194c52af13bb02c8f8c6ffdac3f3e2b779e74"
Oct 30 21:34:51.527253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.527221    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:51.527371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.527312    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:51.527371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.527357    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:51.527637 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.527612    5575 generic.go:356] "Generic (PLEG): container finished" podID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerID="10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda" exitCode=0
Oct 30 21:34:51.527766 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.527687    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" event={"ID":"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2","Type":"ContainerDied","Data":"10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda"}
Oct 30 21:34:51.528141 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.528120    5575 scope.go:122] "RemoveContainer" containerID="10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda"
Oct 30 21:34:51.531065 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.530953    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:51.531065 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.531038    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:51.531215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.531079    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:34:51.531994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:51.531938    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56" event={"ID":"7b8d46bd-7815-4c9b-b3bf-a88121558e3a","Type":"ContainerStarted","Data":"04a71edb4232e09fee953de4e12216dcbab25abec269d45c41236de7f8cea88d"}
Oct 30 21:34:52.580839 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:52.580138    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" event={"ID":"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2","Type":"ContainerStarted","Data":"097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0"}
Oct 30 21:34:52.583914 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:52.583721    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" event={"ID":"fb9f5642-220c-44e0-99be-5151a484e3d3","Type":"ContainerStarted","Data":"ee0f97cf070e86441e721e0324f791bb2319d54362567d4c928aad2cf792508b"}
Oct 30 21:34:52.820151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:52.814365    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:52.820151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:52.814495    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:34:52.820151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:52.814542    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 21:34:52.827572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:52.827343    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:52.827572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:52.827467    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 21:34:52.827572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:52.827512    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 21:34:53.344990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:53.344763    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:53.492235 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:34:53.492201    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:34:53.500216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:53.500149    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:53.826992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:53.820340    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:34:53.826992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:53.820400    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 21:34:53.827563 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:53.827345    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 21:34:53.827563 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:53.827401    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 21:34:54.264535 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:54.264430    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:54.453859 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:54.453784    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:54.827992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:54.814335    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:34:54.827992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:54.814412    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 21:34:54.839988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:54.839370    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 21:34:54.839988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:54.839427    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 21:34:54.987510 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:54.987439    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:55.847993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:55.846463    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:34:55.847993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:55.846525    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 21:34:55.848548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:55.848279    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 21:34:55.848548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:55.848319    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 21:34:56.638989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:56.635727    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56" event={"ID":"7b8d46bd-7815-4c9b-b3bf-a88121558e3a","Type":"ContainerStarted","Data":"99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc"}
Oct 30 21:34:56.638989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:56.636687    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:34:56.759805 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:56.759748    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56" podStartSLOduration=1.921525903 podStartE2EDuration="7.75973322s" totalImagesPullingTime="5.838207317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:56.757383733 +0000 UTC m=+697.789232277" watchObservedRunningTime="2026-10-30 21:34:56.75973322 +0000 UTC m=+697.791581761"
Oct 30 21:34:56.828009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:56.825330    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:34:56.828009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:56.825387    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 21:34:56.828009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:56.826036    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 21:34:56.828009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:56.826071    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 21:34:57.814418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:57.814377    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:34:57.814941 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:57.814450    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 21:34:57.936039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:57.936007    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:57.937050 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:57.937026    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:57.938504 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:57.938486    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 21:34:58.819209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:58.819169    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:58.819600 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:58.819504    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:34:58.820151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:34:58.820132    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:35:00.046388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.046349    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"]
Oct 30 21:35:00.049873 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.049856    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.097140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.097107    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-metrics-certs\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.097278 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.097241    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckbh\" (UniqueName: \"kubernetes.io/projected/f30f0a55-5c94-4435-b49b-e3a62b8400db-kube-api-access-9ckbh\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.097346 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.097309    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.097403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.097352    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f30f0a55-5c94-4435-b49b-e3a62b8400db-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.108631 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.107990    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-691598-serving-cert\""
Oct 30 21:35:00.162859 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.162828    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"]
Oct 30 21:35:00.197829 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.197801    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-metrics-certs\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.198033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.197891    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckbh\" (UniqueName: \"kubernetes.io/projected/f30f0a55-5c94-4435-b49b-e3a62b8400db-kube-api-access-9ckbh\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.198033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.197952    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.198033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.198028    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f30f0a55-5c94-4435-b49b-e3a62b8400db-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.198213 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:35:00.198125    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-serving-cert: secret "maas-api-e2e-worker-w0-691598-serving-cert" not found
Oct 30 21:35:00.198213 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:35:00.198192    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls podName:f30f0a55-5c94-4435-b49b-e3a62b8400db nodeName:}" failed. No retries permitted until 2026-10-30 21:35:00.698172424 +0000 UTC m=+701.730020938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls") pod "maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq" (UID: "f30f0a55-5c94-4435-b49b-e3a62b8400db") : secret "maas-api-e2e-worker-w0-691598-serving-cert" not found
Oct 30 21:35:00.198654 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.198637    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f30f0a55-5c94-4435-b49b-e3a62b8400db-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.200374 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.200352    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-metrics-certs\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.227710 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.227682    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:00.261407 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.261381    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckbh\" (UniqueName: \"kubernetes.io/projected/f30f0a55-5c94-4435-b49b-e3a62b8400db-kube-api-access-9ckbh\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.438403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.438350    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:00.592010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.591952    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:00.703036 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.702943    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.706409 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.706384    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls\") pod \"maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:00.962177 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:00.962104    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:01.340252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:01.340223    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"]
Oct 30 21:35:01.341480 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:35:01.341452    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30f0a55_5c94_4435_b49b_e3a62b8400db.slice/crio-d865d9275461b8c0c1bfd17a3f7d1f270a616a97be25ead72f237385fbedae5e WatchSource:0}: Error finding container d865d9275461b8c0c1bfd17a3f7d1f270a616a97be25ead72f237385fbedae5e: Status 404 returned error can't find the container with id d865d9275461b8c0c1bfd17a3f7d1f270a616a97be25ead72f237385fbedae5e
Oct 30 21:35:01.676239 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:01.676207    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq" event={"ID":"f30f0a55-5c94-4435-b49b-e3a62b8400db","Type":"ContainerStarted","Data":"d865d9275461b8c0c1bfd17a3f7d1f270a616a97be25ead72f237385fbedae5e"}
Oct 30 21:35:02.628697 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:02.628612    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:02.684275 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:02.684247    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq" event={"ID":"f30f0a55-5c94-4435-b49b-e3a62b8400db","Type":"ContainerStarted","Data":"2d62e19d1cd442b30cc707acc6c31642461db6ba1d27ee011edff4cead75b65d"}
Oct 30 21:35:02.684434 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:02.684402    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:02.795746 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:02.795715    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:02.812396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:02.812348    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq" podStartSLOduration=2.916686583 podStartE2EDuration="3.812332757s" totalImagesPullingTime="895.646174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:02.810661529 +0000 UTC m=+703.842510065" watchObservedRunningTime="2026-10-30 21:35:02.812332757 +0000 UTC m=+703.844181324"
Oct 30 21:35:02.968624 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:02.968589    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:03.362780 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:03.362691    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:03.566613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:03.566578    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:03.662356 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:03.662328    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 21:35:05.825707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:05.825672    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:08.697331 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:08.697301    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 21:35:09.053045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:09.052532    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:11.235089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:11.235051    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:11.397869 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:11.397837    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:11.630143 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:11.630062    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:16.309364 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.309329    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"]
Oct 30 21:35:16.312455 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.312439    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.365172 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.365145    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-6ea374-serving-cert\""
Oct 30 21:35:16.388405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.388371    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aff7c8-329a-41fd-863f-c952ef6e5ceb-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.388579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.388439    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.388579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.388561    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-metrics-certs\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.388708 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.388628    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgvhg\" (UniqueName: \"kubernetes.io/projected/80aff7c8-329a-41fd-863f-c952ef6e5ceb-kube-api-access-jgvhg\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.417725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.417693    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"]
Oct 30 21:35:16.489252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.489220    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aff7c8-329a-41fd-863f-c952ef6e5ceb-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.489431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.489268    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.489431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.489303    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-metrics-certs\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.489431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.489333    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgvhg\" (UniqueName: \"kubernetes.io/projected/80aff7c8-329a-41fd-863f-c952ef6e5ceb-kube-api-access-jgvhg\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.489611 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:35:16.489444    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-serving-cert: secret "maas-api-e2e-worker-w1-6ea374-serving-cert" not found
Oct 30 21:35:16.489611 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:35:16.489518    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls podName:80aff7c8-329a-41fd-863f-c952ef6e5ceb nodeName:}" failed. No retries permitted until 2026-10-30 21:35:16.989497648 +0000 UTC m=+718.021346175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls") pod "maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq" (UID: "80aff7c8-329a-41fd-863f-c952ef6e5ceb") : secret "maas-api-e2e-worker-w1-6ea374-serving-cert" not found
Oct 30 21:35:16.489912 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.489891    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aff7c8-329a-41fd-863f-c952ef6e5ceb-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.491795 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.491778    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-metrics-certs\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.553960 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.553926    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgvhg\" (UniqueName: \"kubernetes.io/projected/80aff7c8-329a-41fd-863f-c952ef6e5ceb-kube-api-access-jgvhg\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.582828 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.582761    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:16.768090 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.768051    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:16.925068 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.925027    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:16.994643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.994602    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:16.997270 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:16.997248    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls\") pod \"maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:17.225441 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:17.225361    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:17.524644 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:17.524562    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:17.610382 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:17.610353    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"]
Oct 30 21:35:17.611519 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:35:17.611494    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80aff7c8_329a_41fd_863f_c952ef6e5ceb.slice/crio-91f8aaa7a09c603b492195ec1e2a5f3a94596c2966cbd3caeb18ed18f6a7c967 WatchSource:0}: Error finding container 91f8aaa7a09c603b492195ec1e2a5f3a94596c2966cbd3caeb18ed18f6a7c967: Status 404 returned error can't find the container with id 91f8aaa7a09c603b492195ec1e2a5f3a94596c2966cbd3caeb18ed18f6a7c967
Oct 30 21:35:17.686543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:17.686514    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:17.803562 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:17.803381    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq" event={"ID":"80aff7c8-329a-41fd-863f-c952ef6e5ceb","Type":"ContainerStarted","Data":"91f8aaa7a09c603b492195ec1e2a5f3a94596c2966cbd3caeb18ed18f6a7c967"}
Oct 30 21:35:18.484616 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:18.484584    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:18.812491 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:18.812392    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq" event={"ID":"80aff7c8-329a-41fd-863f-c952ef6e5ceb","Type":"ContainerStarted","Data":"20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f"}
Oct 30 21:35:18.812491 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:18.812468    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:18.930920 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:18.930864    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq" podStartSLOduration=2.024283554 podStartE2EDuration="2.930847448s" totalImagesPullingTime="906.563894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:18.930725059 +0000 UTC m=+719.962573594" watchObservedRunningTime="2026-10-30 21:35:18.930847448 +0000 UTC m=+719.962695984"
Oct 30 21:35:19.079934 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:19.079853    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:19.256447 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:19.256413    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:22.397025 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:22.396992    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:23.485577 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:35:23.485541    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:35:24.823174 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:24.823147    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 21:35:27.391285 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:27.391254    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:31.890529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:31.890431    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:32.370778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:32.370693    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:37.429499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.429458    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"]
Oct 30 21:35:37.433703 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.433680    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.486318 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.486287    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-91874e-serving-cert\""
Oct 30 21:35:37.539135 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.539099    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"]
Oct 30 21:35:37.541789 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.541759    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.541927 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.541827    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzvdn\" (UniqueName: \"kubernetes.io/projected/032f367c-d938-4954-a392-bdefb78d4dd7-kube-api-access-rzvdn\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.541997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.541944    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f367c-d938-4954-a392-bdefb78d4dd7-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.542039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.542019    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-metrics-certs\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.642774 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.642747    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzvdn\" (UniqueName: \"kubernetes.io/projected/032f367c-d938-4954-a392-bdefb78d4dd7-kube-api-access-rzvdn\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.642949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.642789    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f367c-d938-4954-a392-bdefb78d4dd7-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.642949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.642808    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-metrics-certs\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.642949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.642895    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.643105 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:35:37.643089    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-serving-cert: secret "maas-api-e2e-worker-w2-91874e-serving-cert" not found
Oct 30 21:35:37.643176 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:35:37.643157    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls podName:032f367c-d938-4954-a392-bdefb78d4dd7 nodeName:}" failed. No retries permitted until 2026-10-30 21:35:38.143136191 +0000 UTC m=+739.174984709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls") pod "maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4" (UID: "032f367c-d938-4954-a392-bdefb78d4dd7") : secret "maas-api-e2e-worker-w2-91874e-serving-cert" not found
Oct 30 21:35:37.643522 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.643502    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f367c-d938-4954-a392-bdefb78d4dd7-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.645631 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.645609    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-metrics-certs\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.654701 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.654670    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:37.705267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.705228    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzvdn\" (UniqueName: \"kubernetes.io/projected/032f367c-d938-4954-a392-bdefb78d4dd7-kube-api-access-rzvdn\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:37.808820 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.808773    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:37.962831 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:37.962712    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:38.149085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:38.149049    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:38.151814 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:38.151790    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls\") pod \"maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:38.348953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:38.348851    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:38.735450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:38.735420    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"]
Oct 30 21:35:38.737700 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:35:38.737653    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032f367c_d938_4954_a392_bdefb78d4dd7.slice/crio-5e8d51b8cbc7f6791b940f706ab51c5e59c6b14bb5ecd20d2b77d934f239f908 WatchSource:0}: Error finding container 5e8d51b8cbc7f6791b940f706ab51c5e59c6b14bb5ecd20d2b77d934f239f908: Status 404 returned error can't find the container with id 5e8d51b8cbc7f6791b940f706ab51c5e59c6b14bb5ecd20d2b77d934f239f908
Oct 30 21:35:38.976895 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:38.976859    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4" event={"ID":"032f367c-d938-4954-a392-bdefb78d4dd7","Type":"ContainerStarted","Data":"5e8d51b8cbc7f6791b940f706ab51c5e59c6b14bb5ecd20d2b77d934f239f908"}
Oct 30 21:35:39.991293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:39.991195    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4" event={"ID":"032f367c-d938-4954-a392-bdefb78d4dd7","Type":"ContainerStarted","Data":"70684492125b4ed2f0623f9076f468a8840bcfed91cf78e6544667449c161e0a"}
Oct 30 21:35:39.991753 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:39.991677    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:40.115124 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:40.115054    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4" podStartSLOduration=2.19863528 podStartE2EDuration="3.115034461s" totalImagesPullingTime="916.399181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:40.110922609 +0000 UTC m=+741.142771144" watchObservedRunningTime="2026-10-30 21:35:40.115034461 +0000 UTC m=+741.146883039"
Oct 30 21:35:41.003290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:41.003260    5575 generic.go:356] "Generic (PLEG): container finished" podID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerID="5e65dba98d5b434c6de340ecb4ddd3daf57247afa46ba802e327c9781bd07803" exitCode=0
Oct 30 21:35:41.003726 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:41.003326    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" event={"ID":"d5c98795-1764-46b9-a95f-c084ef7f32c5","Type":"ContainerDied","Data":"5e65dba98d5b434c6de340ecb4ddd3daf57247afa46ba802e327c9781bd07803"}
Oct 30 21:35:41.003849 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:41.003837    5575 scope.go:122] "RemoveContainer" containerID="5e65dba98d5b434c6de340ecb4ddd3daf57247afa46ba802e327c9781bd07803"
Oct 30 21:35:41.005007 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:41.004982    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:35:41.005064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:41.005043    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:35:41.005101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:41.005093    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:35:42.040618 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:42.040579    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" event={"ID":"d5c98795-1764-46b9-a95f-c084ef7f32c5","Type":"ContainerStarted","Data":"136c1bf851fbd5840ad3f3506eefff6f6560f06eab1a0974277b2d2f61082010"}
Oct 30 21:35:42.462753 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:42.462721    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:35:42.465135 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:42.465101    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:42.465243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:42.465162    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 21:35:42.787503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:42.787411    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:43.462848 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:43.462810    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:43.463347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:43.462879    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 21:35:44.463323 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:44.463289    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:44.463741 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:44.463348    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 21:35:44.577166 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:44.577133    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:44.936705 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:44.936650    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:45.463582 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:45.463551    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:45.463999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:45.463607    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 21:35:45.608942 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:45.608905    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:45.776061 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:45.775957    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:46.024993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:46.024146    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 21:35:46.462740 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:46.462705    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:46.462958 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:46.462775    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 21:35:47.339032 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:47.338992    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:47.468380 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:47.468345    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:35:47.468882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:47.468864    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:35:47.469600 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:47.469580    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 21:35:47.876896 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:47.876862    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:48.693336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:48.693299    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:49.294690 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:49.294650    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:49.461773 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:49.461743    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:49.620488 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:49.620397    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:53.063913 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:53.063875    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:53.486680 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:35:53.486647    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:35:57.987058 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:35:57.987025    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:02.905408 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:02.905373    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:04.560541 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:04.560508    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:07.855529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:07.855493    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:08.176849 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:08.176805    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:12.675567 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:12.675519    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:12.929804 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:12.929683    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:13.096480 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:13.096451    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:17.949163 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:17.949128    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:18.108424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:18.108386    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:18.577267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:18.577234    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:18.735530 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:18.735483    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:19.954349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:19.954306    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:22.977851 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:22.977808    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:23.488953 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:36:23.488914    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:36:26.954692 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:26.954657    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:28.020388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:28.020347    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:28.176420 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:28.176317    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:28.680006 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:28.679960    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:28.836238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:28.836197    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:30.304856 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:30.304821    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:30.372111 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:30.372075    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:36:30.372282 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:30.372126    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:36:32.400117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:32.400081    5575 generic.go:356] "Generic (PLEG): container finished" podID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerID="1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef" exitCode=0
Oct 30 21:36:32.400560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:32.400131    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" event={"ID":"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50","Type":"ContainerDied","Data":"1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef"}
Oct 30 21:36:32.400560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:32.400510    5575 scope.go:122] "RemoveContainer" containerID="1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef"
Oct 30 21:36:32.401812 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:32.401785    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:36:32.401885 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:32.401852    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:36:32.401943 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:32.401885    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:36:33.091116 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:33.091087    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:33.433398 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:33.433355    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" event={"ID":"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50","Type":"ContainerStarted","Data":"b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2"}
Oct 30 21:36:33.849462 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:33.849366    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:36:33.849667 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:33.849644    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:33.849743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:33.849724    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 21:36:34.849260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:34.849217    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:34.849646 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:34.849312    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 21:36:35.849565 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:35.849533    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:35.849990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:35.849592    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 21:36:36.849412 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:36.849375    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:36.849611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:36.849441    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 21:36:37.849464 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:37.849430    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:37.849629 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:37.849486    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 21:36:37.981106 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:37.981074    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:38.854404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:38.854373    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:36:38.855645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:38.855618    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:36:38.856480 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:38.856435    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:36:43.026841 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:43.026795    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:44.512605 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.512568    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"]
Oct 30 21:36:44.517294 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.517270    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.638311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.638280    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-c7d477\"/\"openshift-service-ca.crt\""
Oct 30 21:36:44.638311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.638300    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-c7d477\"/\"kube-root-ca.crt\""
Oct 30 21:36:44.638569 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.638390    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-c7d477\"/\"default-dockercfg-9xlfk\""
Oct 30 21:36:44.638569 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.638468    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-c7d477\"/\"premium-w5-c7d477-kserve-self-signed-certs\""
Oct 30 21:36:44.641877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.641853    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"]
Oct 30 21:36:44.652794 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.652767    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tls-certs\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.652880 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.652797    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tmp-dir\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.652880 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.652830    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-dshm\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.652987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.652958    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-home\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.653045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.653028    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-model-cache\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.653079 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.653072    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vxkq\" (UniqueName: \"kubernetes.io/projected/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-kube-api-access-4vxkq\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.753784 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.753751    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:44.753784 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.753773    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-home\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.754066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.753893    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-model-cache\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.754066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.753923    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vxkq\" (UniqueName: \"kubernetes.io/projected/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-kube-api-access-4vxkq\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.754066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.754041    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tls-certs\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.754239 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.754071    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tmp-dir\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.754239 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.754150    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-dshm\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.754322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.754231    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-home\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.754424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.754405    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-model-cache\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.754502 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.754476    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tmp-dir\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.756508 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.756482    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-dshm\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.756771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.756755    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tls-certs\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.815782 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.815716    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vxkq\" (UniqueName: \"kubernetes.io/projected/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-kube-api-access-4vxkq\") pod \"premium-w5-c7d477-kserve-54f958b7df-ldsm9\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") " pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:44.831070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:44.831037    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:45.048056 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:45.048021    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:45.215467 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:45.215444    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"]
Oct 30 21:36:45.217374 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:36:45.217346    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07e1d95f_9b0f_4a6c_bfeb_9043fddbfd36.slice/crio-51976f30bcfd7713c8ae6554723dcdf195e37d1cf7620a487c4494af12a53554 WatchSource:0}: Error finding container 51976f30bcfd7713c8ae6554723dcdf195e37d1cf7620a487c4494af12a53554: Status 404 returned error can't find the container with id 51976f30bcfd7713c8ae6554723dcdf195e37d1cf7620a487c4494af12a53554
Oct 30 21:36:45.523369 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:45.523286    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" event={"ID":"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36","Type":"ContainerStarted","Data":"1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288"}
Oct 30 21:36:45.523369 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:45.523333    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" event={"ID":"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36","Type":"ContainerStarted","Data":"51976f30bcfd7713c8ae6554723dcdf195e37d1cf7620a487c4494af12a53554"}
Oct 30 21:36:45.643162 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:45.643109    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podStartSLOduration=1.6430957940000002 podStartE2EDuration="1.643095794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:45.64180438 +0000 UTC m=+806.673652926" watchObservedRunningTime="2026-10-30 21:36:45.643095794 +0000 UTC m=+806.674944328"
Oct 30 21:36:45.831533 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:45.831464    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:48.191949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:48.191917    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:53.096017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:53.095949    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:53.488229 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:36:53.488193    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:36:54.832144 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:54.832107    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:54.844434 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:54.844407    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:55.599449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:55.599423    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:36:58.004068 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:36:58.004034    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:01.407070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:01.406984    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:02.988549 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:02.988519    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:08.079304 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:08.079265    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:13.113108 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:13.113051    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:14.615692 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.615661    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"]
Oct 30 21:37:14.619717 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.619696    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.684260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.684227    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-model-cache\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.684445 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.684278    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2b952f-4903-4c30-9ab7-058f17174990-tls-certs\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.684515 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.684458    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-home\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.684578 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.684558    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-dshm\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.685156 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.684597    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-tmp-dir\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.685156 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.684732    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qn79\" (UniqueName: \"kubernetes.io/projected/2e2b952f-4903-4c30-9ab7-058f17174990-kube-api-access-9qn79\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.732812 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.732786    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-91874e\"/\"simulator-w2-91874e-kserve-self-signed-certs\""
Oct 30 21:37:14.732812 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.732816    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-91874e\"/\"kube-root-ca.crt\""
Oct 30 21:37:14.734138 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.734117    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-91874e\"/\"default-dockercfg-wsbzn\""
Oct 30 21:37:14.734138 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.734118    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-91874e\"/\"openshift-service-ca.crt\""
Oct 30 21:37:14.737103 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.737082    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"]
Oct 30 21:37:14.785809 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.785771    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-home\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.786189 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.786164    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-dshm\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.786344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.786326    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-tmp-dir\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.786581 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.786559    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qn79\" (UniqueName: \"kubernetes.io/projected/2e2b952f-4903-4c30-9ab7-058f17174990-kube-api-access-9qn79\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.786691 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.786664    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-home\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.786691 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.786675    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-model-cache\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.786814 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.786724    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2b952f-4903-4c30-9ab7-058f17174990-tls-certs\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.787134 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.787109    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-model-cache\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.787624 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.787603    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-tmp-dir\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.789922 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.789889    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-dshm\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.790719 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.790695    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2b952f-4903-4c30-9ab7-058f17174990-tls-certs\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.848447 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.848424    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qn79\" (UniqueName: \"kubernetes.io/projected/2e2b952f-4903-4c30-9ab7-058f17174990-kube-api-access-9qn79\") pod \"simulator-w2-91874e-kserve-5dcc766969-v759f\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") " pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:14.863818 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.863792    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:14.931515 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:14.931491    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:15.316518 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:15.316492    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"]
Oct 30 21:37:15.317637 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:37:15.317612    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e2b952f_4903_4c30_9ab7_058f17174990.slice/crio-94fae98db6ce1d283ccab643ad3932907ea62cc59b15be12c93d09353a84f7ab WatchSource:0}: Error finding container 94fae98db6ce1d283ccab643ad3932907ea62cc59b15be12c93d09353a84f7ab: Status 404 returned error can't find the container with id 94fae98db6ce1d283ccab643ad3932907ea62cc59b15be12c93d09353a84f7ab
Oct 30 21:37:15.720632 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:15.720598    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" event={"ID":"2e2b952f-4903-4c30-9ab7-058f17174990","Type":"ContainerStarted","Data":"b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8"}
Oct 30 21:37:15.721113 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:15.720644    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" event={"ID":"2e2b952f-4903-4c30-9ab7-058f17174990","Type":"ContainerStarted","Data":"94fae98db6ce1d283ccab643ad3932907ea62cc59b15be12c93d09353a84f7ab"}
Oct 30 21:37:15.842555 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:15.842496    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podStartSLOduration=1.842477178 podStartE2EDuration="1.842477178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:15.838618601 +0000 UTC m=+836.870467136" watchObservedRunningTime="2026-10-30 21:37:15.842477178 +0000 UTC m=+836.874325713"
Oct 30 21:37:15.932624 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:15.932593    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:18.218933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:18.218889    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:23.171453 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:23.171415    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:23.488539 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:37:23.488462    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:37:24.937694 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:24.936256    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:24.957815 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:24.957779    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:25.674343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:25.674301    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:25.800086 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:25.800061    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:37:28.421478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:28.421439    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:33.282826 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:33.282794    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:38.150171 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:38.150139    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:41.474300 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.474265    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"]
Oct 30 21:37:41.478236 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.478210    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.482679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.482651    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94d94\" (UniqueName: \"kubernetes.io/projected/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-kube-api-access-94d94\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.482817 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.482717    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tmp-dir\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.482883 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.482826    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-model-cache\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.482939 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.482910    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-dshm\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.483004 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.482936    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-home\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.483058 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.483018    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tls-certs\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.536432 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.536403    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"]
Oct 30 21:37:41.582935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.582907    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-691598\"/\"default-dockercfg-nbw99\""
Oct 30 21:37:41.583142 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.583001    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-691598\"/\"premium-w0-691598-kserve-self-signed-certs\""
Oct 30 21:37:41.583142 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.583031    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-691598\"/\"kube-root-ca.crt\""
Oct 30 21:37:41.583142 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.583036    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-691598\"/\"openshift-service-ca.crt\""
Oct 30 21:37:41.583789 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.583769    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94d94\" (UniqueName: \"kubernetes.io/projected/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-kube-api-access-94d94\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.583824 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.583814    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tmp-dir\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.583864 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.583842    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-model-cache\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.583901 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.583891    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-dshm\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.583954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.583914    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-home\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.583954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.583948    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tls-certs\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.584326 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.584305    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tmp-dir\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.584409 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.584342    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-model-cache\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.584409 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.584365    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-home\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.586484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.586463    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-dshm\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.586649 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.586633    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tls-certs\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.599288 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.599267    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:41.645638 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.645609    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94d94\" (UniqueName: \"kubernetes.io/projected/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-kube-api-access-94d94\") pod \"premium-w0-691598-kserve-6849c644d8-zpkmx\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") " pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:41.790658 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:41.790572    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:42.204178 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:42.204152    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"]
Oct 30 21:37:42.205029 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:37:42.205000    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode39a3fa7_4979_4555_ac5a_1ab836e7eb98.slice/crio-27e8649a8892182adc876845345a9fbfd86a27e00a5cbe4a3fd155c0f474d863 WatchSource:0}: Error finding container 27e8649a8892182adc876845345a9fbfd86a27e00a5cbe4a3fd155c0f474d863: Status 404 returned error can't find the container with id 27e8649a8892182adc876845345a9fbfd86a27e00a5cbe4a3fd155c0f474d863
Oct 30 21:37:42.911442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:42.911398    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" event={"ID":"e39a3fa7-4979-4555-ac5a-1ab836e7eb98","Type":"ContainerStarted","Data":"592c7a17801df68ba9032df9f6777e50ae10f4da308be2143bdab442023aabf4"}
Oct 30 21:37:42.911822 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:42.911451    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" event={"ID":"e39a3fa7-4979-4555-ac5a-1ab836e7eb98","Type":"ContainerStarted","Data":"27e8649a8892182adc876845345a9fbfd86a27e00a5cbe4a3fd155c0f474d863"}
Oct 30 21:37:43.031646 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:43.031596    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podStartSLOduration=2.031583016 podStartE2EDuration="2.031583016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:43.030145137 +0000 UTC m=+864.061993672" watchObservedRunningTime="2026-10-30 21:37:43.031583016 +0000 UTC m=+864.063431551"
Oct 30 21:37:43.074940 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:43.074914    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:43.790727 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:43.790687    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:45.283884 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:45.283851    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:47.970332 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:47.970298    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:51.791095 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:51.791060    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:51.804173 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:51.804148    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:51.985313 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:51.985278    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:37:53.085830 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:53.085777    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:53.491123 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:37:53.491086    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:37:58.029363 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:37:58.029327    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:02.887491 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:02.887439    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:07.779933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:07.779893    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:10.816533 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:10.816504    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:12.690236 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:12.690207    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:13.712515 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:13.712486    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"]
Oct 30 21:38:13.712915 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:13.712717    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy" containerID="cri-o://ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4" gracePeriod=30
Oct 30 21:38:17.236138 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:17.236098    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6q26d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:38:17.236524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:17.236149    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:38:17.613150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:17.613065    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:18.997939 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:18.997879    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:38:19.095594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095563    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-envoy\") pod \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") "
Oct 30 21:38:19.095762 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095618    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-socket\") pod \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") "
Oct 30 21:38:19.095762 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095660    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-certs\") pod \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") "
Oct 30 21:38:19.095762 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095701    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-credential-socket\") pod \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") "
Oct 30 21:38:19.095933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095761    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-data\") pod \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") "
Oct 30 21:38:19.095933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095799    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-kube-api-access-cm8m4\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-kube-api-access-cm8m4\") pod \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") "
Oct 30 21:38:19.095933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095842    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istiod-ca-cert\") pod \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") "
Oct 30 21:38:19.095933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095874    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-token\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-token\") pod \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") "
Oct 30 21:38:19.095933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095922    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-socket" pod "404ed8ef-1e29-490e-bd9a-1b8453b42f2a" (UID: "404ed8ef-1e29-490e-bd9a-1b8453b42f2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:38:19.096210 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095958    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-certs" pod "404ed8ef-1e29-490e-bd9a-1b8453b42f2a" (UID: "404ed8ef-1e29-490e-bd9a-1b8453b42f2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:38:19.096210 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.095993    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-podinfo\") pod \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\" (UID: \"404ed8ef-1e29-490e-bd9a-1b8453b42f2a\") "
Oct 30 21:38:19.096210 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.096069    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-credential-socket" pod "404ed8ef-1e29-490e-bd9a-1b8453b42f2a" (UID: "404ed8ef-1e29-490e-bd9a-1b8453b42f2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:38:19.096210 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.096109    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-data" pod "404ed8ef-1e29-490e-bd9a-1b8453b42f2a" (UID: "404ed8ef-1e29-490e-bd9a-1b8453b42f2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:38:19.096412 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.096237    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istiod-ca-cert" pod "404ed8ef-1e29-490e-bd9a-1b8453b42f2a" (UID: "404ed8ef-1e29-490e-bd9a-1b8453b42f2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:19.096511 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.096489    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:19.096577 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.096517    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:19.096801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.096537    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:19.096801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.096660    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:19.096801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.096729    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:19.098310 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.098288    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-token" pod "404ed8ef-1e29-490e-bd9a-1b8453b42f2a" (UID: "404ed8ef-1e29-490e-bd9a-1b8453b42f2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:19.098310 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.098295    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-podinfo" pod "404ed8ef-1e29-490e-bd9a-1b8453b42f2a" (UID: "404ed8ef-1e29-490e-bd9a-1b8453b42f2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:38:19.098439 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.098319    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-envoy" pod "404ed8ef-1e29-490e-bd9a-1b8453b42f2a" (UID: "404ed8ef-1e29-490e-bd9a-1b8453b42f2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:38:19.098439 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.098369    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-kube-api-access-cm8m4" pod "404ed8ef-1e29-490e-bd9a-1b8453b42f2a" (UID: "404ed8ef-1e29-490e-bd9a-1b8453b42f2a"). InnerVolumeSpecName "kube-api-access-cm8m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:19.164587 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.164555    5575 generic.go:356] "Generic (PLEG): container finished" podID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerID="ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4" exitCode=0
Oct 30 21:38:19.164739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.164619    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"
Oct 30 21:38:19.164739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.164623    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" event={"ID":"404ed8ef-1e29-490e-bd9a-1b8453b42f2a","Type":"ContainerDied","Data":"ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4"}
Oct 30 21:38:19.164739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.164681    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d" event={"ID":"404ed8ef-1e29-490e-bd9a-1b8453b42f2a","Type":"ContainerDied","Data":"07236defdcc0136d94322d1707be1b300fd3908d171357e0e9172f3581d8f8e9"}
Oct 30 21:38:19.164739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.164713    5575 scope.go:122] "RemoveContainer" containerID="ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4"
Oct 30 21:38:19.175441 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.175416    5575 scope.go:122] "RemoveContainer" containerID="659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0"
Oct 30 21:38:19.185332 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.185312    5575 scope.go:122] "RemoveContainer" containerID="ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4"
Oct 30 21:38:19.185645 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:38:19.185621    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4\": container with ID starting with ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4 not found: ID does not exist" containerID="ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4"
Oct 30 21:38:19.185716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.185660    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4"} err="failed to get container status \"ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4\": rpc error: code = NotFound desc = could not find container \"ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4\": container with ID starting with ec948f1282f39161ee61b71531c06cd0aa265daef06b0f9026a5c25d6b59f8a4 not found: ID does not exist"
Oct 30 21:38:19.185716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.185680    5575 scope.go:122] "RemoveContainer" containerID="659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0"
Oct 30 21:38:19.186028 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:38:19.186002    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0\": container with ID starting with 659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0 not found: ID does not exist" containerID="659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0"
Oct 30 21:38:19.186118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.186035    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0"} err="failed to get container status \"659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0\": rpc error: code = NotFound desc = could not find container \"659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0\": container with ID starting with 659f40b52465fbfe35f5878cb6af41e68b162c9bb34f18c32cb670c93271dbf0 not found: ID does not exist"
Oct 30 21:38:19.198458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.198432    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:19.198458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.198465    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm8m4\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-kube-api-access-cm8m4\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:19.198599 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.198481    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:19.198599 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.198494    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404ed8ef-1e29-490e-bd9a-1b8453b42f2a-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:19.267507 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.267435    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:38:19.271002 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.270978    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:38:19.286070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.286042    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:38:19.290229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.290205    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:38:19.293167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.293130    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"]
Oct 30 21:38:19.296726 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.296706    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6q26d"]
Oct 30 21:38:19.455112 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.455067    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:19.653839 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.653794    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:19.859718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.859674    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"]
Oct 30 21:38:19.860297 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.860280    5575 cpu_manager.go:414] "containerMap: removing container" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy"
Oct 30 21:38:19.860358 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.860299    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy"
Oct 30 21:38:19.860358 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.860327    5575 cpu_manager.go:414] "containerMap: removing container" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy"
Oct 30 21:38:19.860358 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.860332    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy"
Oct 30 21:38:19.860450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.860415    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy"
Oct 30 21:38:19.860450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.860427    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" containerName="istio-proxy"
Oct 30 21:38:19.865444 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.865422    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.905153 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.905081    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-data\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.905298 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.905178    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj8rq\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-kube-api-access-pj8rq\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.905298 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.905241    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-certs\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.905430 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.905327    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.905430 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.905373    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-envoy\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.905537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.905517    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-podinfo\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.905597 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.905554    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-credential-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.905657 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.905635    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istiod-ca-cert\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.905715 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.905682    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-token\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:19.918526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.918503    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-c7d477-openshift-default-dockercfg-q6mxs\""
Oct 30 21:38:19.927200 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.927174    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"]
Oct 30 21:38:19.965405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:19.965377    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.010320    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-podinfo\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.010379    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-credential-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.010424    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istiod-ca-cert\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.010458    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-token\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.010538    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-data\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.010561    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj8rq\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-kube-api-access-pj8rq\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.010610    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-certs\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.010637    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.010663    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-envoy\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.011603    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-credential-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.012720    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istiod-ca-cert\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.014418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.013475    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-data\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.014418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.013598    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-certs\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.014418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.013762    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.016755 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.016725    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-podinfo\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.017125 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.017062    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-envoy\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.073101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.073072    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj8rq\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-kube-api-access-pj8rq\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.073330 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.073307    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-token\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.178769 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.178680    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:20.181000 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.180977    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"]
Oct 30 21:38:20.185097 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.185079    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.213639 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.213615    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-certs\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.213766 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.213644    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istiod-ca-cert\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.213766 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.213673    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-token\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.213881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.213834    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-credential-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.213999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.213948    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.214069 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.214016    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-data\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.214136 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.214118    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-podinfo\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.214237 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.214220    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-envoy\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.214389 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.214367    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgk56\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-kube-api-access-wgk56\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.251992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.238414    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-691598-openshift-default-dockercfg-trswq\""
Oct 30 21:38:20.264068 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.260424    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"]
Oct 30 21:38:20.315901 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.315869    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-envoy\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.316092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.315928    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgk56\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-kube-api-access-wgk56\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.316092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.315976    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-certs\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.316092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.316001    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istiod-ca-cert\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.316384 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.316361    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-certs\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.316541 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.316358    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-token\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.316541 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.316499    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-credential-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.316652 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.316583    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.316652 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.316615    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-data\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.318246 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.316876    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istiod-ca-cert\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.318246 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.317153    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-podinfo\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.318246 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.317282    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.318246 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.317617    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-data\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.318246 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.318109    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-credential-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.319106 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.319086    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-envoy\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.319931 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.319909    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-podinfo\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.378400 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.378364    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-token\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.378631 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.378615    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgk56\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-kube-api-access-wgk56\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.519130 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.519058    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:20.626896 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.626864    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"]
Oct 30 21:38:20.634692 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.634654    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:38:20.634782 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.634740    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:38:20.634828 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.634779    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:38:20.909546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.909507    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"]
Oct 30 21:38:20.913154 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:38:20.913124    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb9c3bb_ddb2_46b8_8d83_92a576b0aa15.slice/crio-4ec124badfab0bbb32b24ffdbe3d96da514e33e029684b263c7559f30513b35f WatchSource:0}: Error finding container 4ec124badfab0bbb32b24ffdbe3d96da514e33e029684b263c7559f30513b35f: Status 404 returned error can't find the container with id 4ec124badfab0bbb32b24ffdbe3d96da514e33e029684b263c7559f30513b35f
Oct 30 21:38:20.915899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.915858    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:38:20.915990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.915931    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:38:20.915990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:20.915960    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:38:21.131195 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.131156    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="404ed8ef-1e29-490e-bd9a-1b8453b42f2a" path="/var/lib/kubelet/pods/404ed8ef-1e29-490e-bd9a-1b8453b42f2a/volumes"
Oct 30 21:38:21.182646 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.182529    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" event={"ID":"bfc9be4e-8b02-46d5-95d7-717ac210b70e","Type":"ContainerStarted","Data":"ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a"}
Oct 30 21:38:21.182646 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.182595    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" event={"ID":"bfc9be4e-8b02-46d5-95d7-717ac210b70e","Type":"ContainerStarted","Data":"120b10a31db0b2960a0740d0a67a497392bb3928d005328708ba83bd1b5f8a8b"}
Oct 30 21:38:21.184453 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.184425    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" event={"ID":"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15","Type":"ContainerStarted","Data":"576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1"}
Oct 30 21:38:21.184610 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.184472    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" event={"ID":"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15","Type":"ContainerStarted","Data":"4ec124badfab0bbb32b24ffdbe3d96da514e33e029684b263c7559f30513b35f"}
Oct 30 21:38:21.305995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.304944    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" podStartSLOduration=2.30492461 podStartE2EDuration="2.30492461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:21.304463148 +0000 UTC m=+902.336311697" watchObservedRunningTime="2026-10-30 21:38:21.30492461 +0000 UTC m=+902.336773148"
Oct 30 21:38:21.441802 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.441636    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podStartSLOduration=1.440170464 podStartE2EDuration="1.440170464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:21.426513907 +0000 UTC m=+902.458362468" watchObservedRunningTime="2026-10-30 21:38:21.440170464 +0000 UTC m=+902.472018999"
Oct 30 21:38:21.519992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.519445    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:21.535212 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.523202    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:21.535212 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:21.523258    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:22.180077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:22.180044    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:22.181010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:22.180627    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:22.181010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:22.180756    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:22.480053 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:22.479068    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:22.523992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:22.523456    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:22.523992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:22.523550    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:23.187992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:23.185335    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:23.187992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:23.185396    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:23.492038 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:38:23.491289    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:38:23.523991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:23.522361    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:23.523991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:23.522423    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:24.179670 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:24.179629    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:24.179846 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:24.179722    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:24.520447 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:24.520338    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:24.521181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:24.521150    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:25.179799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:25.179763    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:25.180103 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:25.180073    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:25.526045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:25.523378    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:25.526045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:25.523457    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:26.179730 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:26.179697    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:26.179891 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:26.179754    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:26.525044 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:26.521304    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:26.525044 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:26.521365    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:27.180130 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:27.180093    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:27.180547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:27.180161    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:27.386694 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:27.386656    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:27.521472 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:27.521378    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:27.521755 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:27.521706    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:28.187356 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:28.187324    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:28.187868 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:28.187844    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:28.188587 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:28.188565    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 21:38:28.531466 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:28.531396    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:28.532010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:28.531987    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:28.532816 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:28.532796    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 21:38:32.261361 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:32.261268    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:35.477513 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:35.477445    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:37.185075 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:37.185045    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:42.058487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:42.058456    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:45.633453 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:45.633412    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:47.161264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:47.161231    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:52.055062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:52.055023    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:53.486407 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:38:53.486369    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:38:56.962406 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:38:56.962314    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:01.919314 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:01.919273    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:03.855085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.855054    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"]
Oct 30 21:39:03.858887 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.858870    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:03.949269 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.949238    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"]
Oct 30 21:39:03.960957 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.960931    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-certs\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:03.960957 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.960960    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-podinfo\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:03.961209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.961083    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-data\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:03.961209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.961138    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istiod-ca-cert\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:03.961209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.961158    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvbkv\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-kube-api-access-tvbkv\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:03.961209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.961184    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:03.961420 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.961236    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-token\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:03.961420 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.961402    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-credential-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:03.961531 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:03.961474    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-envoy\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.062628 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.062598    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-credential-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.062797 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.062657    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-envoy\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.062797 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.062694    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-certs\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.062797 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.062714    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-podinfo\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.062797 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.062754    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-data\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.063057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.062815    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istiod-ca-cert\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.063057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.062842    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbkv\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-kube-api-access-tvbkv\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.063057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.062873    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.063057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.062897    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-token\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.063260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.063080    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-credential-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.063311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.063288    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-data\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.063410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.063360    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.063698 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.063467    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-certs\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.063698 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.063631    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istiod-ca-cert\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.065294 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.065271    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-envoy\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.065394 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.065377    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-podinfo\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.124013 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.123940    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-token\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.124470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.124441    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvbkv\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-kube-api-access-tvbkv\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.172542 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.172514    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:04.610019 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.609991    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"]
Oct 30 21:39:04.611283 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:39:04.611260    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7512fc0d_f93b_4922_9a51_e7d86db87ba7.slice/crio-dcd0b9ccde217ed6effe0166988b45a996f4d480fade1e585bdf8f7923b15d30 WatchSource:0}: Error finding container dcd0b9ccde217ed6effe0166988b45a996f4d480fade1e585bdf8f7923b15d30: Status 404 returned error can't find the container with id dcd0b9ccde217ed6effe0166988b45a996f4d480fade1e585bdf8f7923b15d30
Oct 30 21:39:04.613524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.613490    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:39:04.613633 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.613567    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:39:04.613633 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:04.613610    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:39:05.539826 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:05.539791    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" event={"ID":"7512fc0d-f93b-4922-9a51-e7d86db87ba7","Type":"ContainerStarted","Data":"53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9"}
Oct 30 21:39:05.540273 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:05.539847    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" event={"ID":"7512fc0d-f93b-4922-9a51-e7d86db87ba7","Type":"ContainerStarted","Data":"dcd0b9ccde217ed6effe0166988b45a996f4d480fade1e585bdf8f7923b15d30"}
Oct 30 21:39:06.173481 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:06.173446    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:06.180990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:06.178839    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:39:06.180990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:06.178902    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:39:06.942612 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:06.942576    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:07.173806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:07.173771    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:39:07.174024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:07.173829    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:39:08.173334 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:08.173296    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:39:08.173739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:08.173351    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:39:09.173284 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:09.173253    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:39:09.173449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:09.173310    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:39:10.172980 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:10.172944    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:39:10.173145 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:10.173017    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:39:11.491753 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:11.491721    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:11.495356 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:11.495333    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:11.497002 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:11.496957    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 21:39:11.756046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:11.752534    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" podStartSLOduration=8.752509912 podStartE2EDuration="8.752509912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:05.718649175 +0000 UTC m=+946.750497712" watchObservedRunningTime="2026-10-30 21:39:11.752509912 +0000 UTC m=+952.784358449"
Oct 30 21:39:11.803701 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:11.803670    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:16.758307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:16.758273    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:21.587460 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:21.587426    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:23.488904 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:39:23.488871    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:39:26.475313 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:26.475278    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:31.358374 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:31.358340    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:35.378707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:35.378666    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:36.506451 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:36.506410    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:41.485403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:41.485369    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:44.444290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.444254    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"]
Oct 30 21:39:44.448549 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.448523    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.525095 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.525063    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"]
Oct 30 21:39:44.565465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.565429    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.565649 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.565479    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.565649 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.565514    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.565649 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.565539    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.565649 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.565626    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.565877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.565665    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.565877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.565753    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89732d10-f523-4a3e-90f4-f01a95f99bfb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.565877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.565783    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk5r6\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-kube-api-access-wk5r6\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.566080 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.565957    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667410    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667439    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667460    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667475    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667528    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667555    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667621    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89732d10-f523-4a3e-90f4-f01a95f99bfb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667653    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk5r6\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-kube-api-access-wk5r6\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667708    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.667961 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.667852    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.668061 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.668039    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.668109 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.668094    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.668164 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.668110    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.668546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.668523    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89732d10-f523-4a3e-90f4-f01a95f99bfb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.670104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.670080    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.670306 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.670289    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.729470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.729407    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk5r6\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-kube-api-access-wk5r6\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.729622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.729604    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-jl49j\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:44.767531 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:44.767503    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:45.260820 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:45.260790    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"]
Oct 30 21:39:45.261733 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:39:45.261708    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89732d10_f523_4a3e_90f4_f01a95f99bfb.slice/crio-055b88504a1571d3394279c91132a2a3b03e74411c6ef5b84d58627fe080f773 WatchSource:0}: Error finding container 055b88504a1571d3394279c91132a2a3b03e74411c6ef5b84d58627fe080f773: Status 404 returned error can't find the container with id 055b88504a1571d3394279c91132a2a3b03e74411c6ef5b84d58627fe080f773
Oct 30 21:39:45.264287 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:45.264246    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:39:45.264370 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:45.264334    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:39:45.264413 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:45.264382    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:39:45.873050 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:45.873017    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" event={"ID":"89732d10-f523-4a3e-90f4-f01a95f99bfb","Type":"ContainerStarted","Data":"ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e"}
Oct 30 21:39:45.873480 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:45.873074    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" event={"ID":"89732d10-f523-4a3e-90f4-f01a95f99bfb","Type":"ContainerStarted","Data":"055b88504a1571d3394279c91132a2a3b03e74411c6ef5b84d58627fe080f773"}
Oct 30 21:39:45.980988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:45.980932    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:46.048742 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:46.048688    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" podStartSLOduration=2.048667918 podStartE2EDuration="2.048667918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:45.995937253 +0000 UTC m=+987.027785785" watchObservedRunningTime="2026-10-30 21:39:46.048667918 +0000 UTC m=+987.080516452"
Oct 30 21:39:46.301442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:46.301399    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:46.768138 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:46.768099    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:46.769836 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:46.769813    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-jl49j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:39:46.769902 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:46.769868    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:39:47.768875 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:47.768835    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-jl49j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:39:47.769390 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:47.768896    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:39:48.768484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:48.768454    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-jl49j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:39:48.768744 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:48.768504    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:39:49.768706 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:49.768665    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-jl49j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:39:49.769107 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:49.768742    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:39:50.768868 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:50.768827    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-jl49j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:39:50.769377 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:50.768894    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:39:51.283594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:51.283559    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:51.768336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:51.768299    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-jl49j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:39:51.768513 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:51.768379    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:39:52.768205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:52.768164    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-jl49j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:39:52.768605 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:52.768233    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:39:53.488440 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:39:53.488398    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:39:53.772436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:53.772364    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:53.772881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:53.772864    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:53.773641 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:53.773624    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:39:56.272921 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:56.272883    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:59.442427 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.442345    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"]
Oct 30 21:39:59.447215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.447197    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.459893 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.459871    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.460028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.459898    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.460028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.459928    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.460116 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.460090    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.460223 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.460206    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.460257 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.460238    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d1c316-3569-4d07-b3f4-897ac99c9a79-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.460297 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.460272    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.460377 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.460354    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.460438 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.460414    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2mtq\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-kube-api-access-r2mtq\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.555144 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.555109    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"]
Oct 30 21:39:59.561273 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561244    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561283    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561327    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561358    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561430    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561455    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d1c316-3569-4d07-b3f4-897ac99c9a79-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561483    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561810 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561527    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561810 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561601    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2mtq\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-kube-api-access-r2mtq\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561810 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561666    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.561810 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.561680    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.562546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.562490    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.563055 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.563032    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d1c316-3569-4d07-b3f4-897ac99c9a79-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.563312 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.563154    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.564940 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.564909    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.575319 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.575291    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.586171 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.586144    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"]
Oct 30 21:39:59.590881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.590865    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.626002 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.624982    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2mtq\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-kube-api-access-r2mtq\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.626002 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.625043    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.636074 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.636043    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"]
Oct 30 21:39:59.663252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.663225    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.663354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.663297    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.663478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.663452    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.663517 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.663499    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.663581 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.663564    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.663630 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.663614    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.663731 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.663715    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/955aa6b9-e73c-49b0-84b6-238c381a2b87-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.663801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.663788    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.663847 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.663820    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsz4v\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-kube-api-access-vsz4v\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.761392 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.761320    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:39:59.764755 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.764500    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.764755 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.764540    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.764755 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.764565    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.764755 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.764706    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.764755 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.764745    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/955aa6b9-e73c-49b0-84b6-238c381a2b87-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.765049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.764817    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.765049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.764845    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsz4v\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-kube-api-access-vsz4v\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.765049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.764937    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.765049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.765023    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.765049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.765031    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.765288 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.765075    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.765288 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.765165    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.765447 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.765425    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.765540 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.765507    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/955aa6b9-e73c-49b0-84b6-238c381a2b87-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.767906 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.767874    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.768055 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.767996    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.830024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.826836    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.830024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.827308    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsz4v\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-kube-api-access-vsz4v\") pod \"maas-default-gateway-openshift-default-75d7c785f-77kb4\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:39:59.908918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:39:59.908885    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:40:00.194515 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:00.194491    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"]
Oct 30 21:40:00.196106 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:40:00.196078    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d1c316_3569_4d07_b3f4_897ac99c9a79.slice/crio-abcd1c0332e1bccbcf8df9161a7092799c13dc2b6bc589968ccfb84e83afe7b8 WatchSource:0}: Error finding container abcd1c0332e1bccbcf8df9161a7092799c13dc2b6bc589968ccfb84e83afe7b8: Status 404 returned error can't find the container with id abcd1c0332e1bccbcf8df9161a7092799c13dc2b6bc589968ccfb84e83afe7b8
Oct 30 21:40:00.198504 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:00.198472    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:00.198620 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:00.198543    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:00.198620 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:00.198593    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:00.296992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:00.296946    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"]
Oct 30 21:40:00.298954 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:40:00.298916    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955aa6b9_e73c_49b0_84b6_238c381a2b87.slice/crio-2511abba6cf05b6dc567d5f42b0e217cb9abf732924e2e94bad7183a7003fb6f WatchSource:0}: Error finding container 2511abba6cf05b6dc567d5f42b0e217cb9abf732924e2e94bad7183a7003fb6f: Status 404 returned error can't find the container with id 2511abba6cf05b6dc567d5f42b0e217cb9abf732924e2e94bad7183a7003fb6f
Oct 30 21:40:00.301509 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:00.301475    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:00.301596 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:00.301542    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:00.301596 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:00.301575    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:01.024768 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.024727    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" event={"ID":"955aa6b9-e73c-49b0-84b6-238c381a2b87","Type":"ContainerStarted","Data":"782ae492f934dffb053d7efe595e96ad3f1360540ec39cf125cead7be6cdd4db"}
Oct 30 21:40:01.025410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.025382    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" event={"ID":"955aa6b9-e73c-49b0-84b6-238c381a2b87","Type":"ContainerStarted","Data":"2511abba6cf05b6dc567d5f42b0e217cb9abf732924e2e94bad7183a7003fb6f"}
Oct 30 21:40:01.031998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.029000    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" event={"ID":"31d1c316-3569-4d07-b3f4-897ac99c9a79","Type":"ContainerStarted","Data":"32705a4f4b7b38a2a11dfd916149c926e9b4231736a6eafdfc278b6bf72e20d1"}
Oct 30 21:40:01.031998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.029052    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" event={"ID":"31d1c316-3569-4d07-b3f4-897ac99c9a79","Type":"ContainerStarted","Data":"abcd1c0332e1bccbcf8df9161a7092799c13dc2b6bc589968ccfb84e83afe7b8"}
Oct 30 21:40:01.365726 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.365631    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podStartSLOduration=2.365615717 podStartE2EDuration="2.365615717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:01.24436865 +0000 UTC m=+1002.276217186" watchObservedRunningTime="2026-10-30 21:40:01.365615717 +0000 UTC m=+1002.397464251"
Oct 30 21:40:01.369418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.369371    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podStartSLOduration=2.369360964 podStartE2EDuration="2.369360964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:01.365354808 +0000 UTC m=+1002.397203356" watchObservedRunningTime="2026-10-30 21:40:01.369360964 +0000 UTC m=+1002.401209499"
Oct 30 21:40:01.390318 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.390289    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:01.768436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.768281    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:40:01.772010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.770259    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:40:01.772010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.770324    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:40:01.926994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.910284    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:40:01.926994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.915866    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-77kb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:40:01.926994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:01.915923    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:40:02.764998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:02.764468    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:40:02.764998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:02.764551    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:40:02.910992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:02.910347    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-77kb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:40:02.910992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:02.910404    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:40:03.762989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:03.762215    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:40:03.762989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:03.762279    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:40:03.916989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:03.916342    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-77kb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:40:03.916989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:03.916402    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:40:04.761979 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:04.761933    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:40:04.762166 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:04.762023    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:40:04.926993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:04.918192    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-77kb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:40:04.926993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:04.918251    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:40:05.762778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:05.762232    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:40:05.762778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:05.762291    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:40:05.913993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:05.911326    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-77kb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:40:05.913993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:05.911385    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:40:06.375912 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:06.375876    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:06.762106 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:06.762066    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:40:06.762316 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:06.762148    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:40:06.910190 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:06.910155    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-77kb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:40:06.910391 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:06.910222    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:40:07.766600 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:07.766570    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:40:07.767030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:07.766924    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:40:07.767534 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:07.767516    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:40:07.909643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:07.909610    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-77kb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:40:07.909897 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:07.909662    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:40:08.913870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:08.913835    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:40:08.914285 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:08.914253    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:40:08.914913 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:08.914892    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:40:11.557990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:11.551613    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:16.567350 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:16.567315    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:21.196695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:21.196658    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:21.743991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:21.742944    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:23.485510 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:40:23.485477    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:40:26.500429 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:26.500376    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:26.678355 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:26.678326    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:31.573503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:31.573466    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:32.074762 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.074731    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"]
Oct 30 21:40:32.080113 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.080097    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.136442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.136410    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-dshm\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.136607 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.136453    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-tmp-dir\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.136607 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.136508    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-model-cache\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.136607 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.136540    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdfw5\" (UniqueName: \"kubernetes.io/projected/3cc981be-9931-4457-a0e6-17fab076f721-kube-api-access-fdfw5\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.136892 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.136589    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-home\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.137051 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.137029    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cc981be-9931-4457-a0e6-17fab076f721-tls-certs\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.158229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.158202    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"]
Oct 30 21:40:32.183387 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.183364    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-691598\"/\"distinct-w0-691598-kserve-self-signed-certs\""
Oct 30 21:40:32.185543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.185522    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:32.239090 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.239050    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-dshm\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.239353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.239099    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-tmp-dir\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.239353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.239160    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-model-cache\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.239353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.239191    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdfw5\" (UniqueName: \"kubernetes.io/projected/3cc981be-9931-4457-a0e6-17fab076f721-kube-api-access-fdfw5\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.239353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.239244    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-home\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.239590 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.239360    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cc981be-9931-4457-a0e6-17fab076f721-tls-certs\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.239894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.239865    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-model-cache\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.240172 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.240148    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-home\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.240476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.240455    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-tmp-dir\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.243385 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.243360    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cc981be-9931-4457-a0e6-17fab076f721-tls-certs\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.246825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.246797    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-dshm\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.301446 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.301415    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdfw5\" (UniqueName: \"kubernetes.io/projected/3cc981be-9931-4457-a0e6-17fab076f721-kube-api-access-fdfw5\") pod \"distinct-w0-691598-kserve-64f7b6f78c-sgrcq\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") " pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.393070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.393046    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:32.795141 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:32.795111    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"]
Oct 30 21:40:32.795868 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:40:32.795846    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cc981be_9931_4457_a0e6_17fab076f721.slice/crio-d6a992f42ddecb0cbaf40d01116ec46bb9aad13403eb8ad00989c6af87f8fd3f WatchSource:0}: Error finding container d6a992f42ddecb0cbaf40d01116ec46bb9aad13403eb8ad00989c6af87f8fd3f: Status 404 returned error can't find the container with id d6a992f42ddecb0cbaf40d01116ec46bb9aad13403eb8ad00989c6af87f8fd3f
Oct 30 21:40:33.303996 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:33.303955    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" event={"ID":"3cc981be-9931-4457-a0e6-17fab076f721","Type":"ContainerStarted","Data":"c72d5ecc7853d7e900d9c73680dd35b4b396a1e800602506104e8e70e0690a34"}
Oct 30 21:40:33.304159 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:33.304002    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" event={"ID":"3cc981be-9931-4457-a0e6-17fab076f721","Type":"ContainerStarted","Data":"d6a992f42ddecb0cbaf40d01116ec46bb9aad13403eb8ad00989c6af87f8fd3f"}
Oct 30 21:40:33.393987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:33.393941    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:33.421224 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:33.421177    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podStartSLOduration=1.421163425 podStartE2EDuration="1.421163425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:33.420330385 +0000 UTC m=+1034.452178921" watchObservedRunningTime="2026-10-30 21:40:33.421163425 +0000 UTC m=+1034.453011960"
Oct 30 21:40:34.913570 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.913540    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"]
Oct 30 21:40:34.918101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.918077    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:34.970639 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.970613    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-6ea374-openshift-default-dockercfg-jjxj8\""
Oct 30 21:40:34.973305 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.973283    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istiod-ca-cert\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:34.973387 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.973330    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-certs\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:34.973387 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.973372    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4268\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-kube-api-access-t4268\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:34.973478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.973437    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-credential-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:34.973536 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.973492    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-envoy\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:34.973643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.973618    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-token\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:34.973861 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.973836    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-podinfo\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:34.974044 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.974023    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:34.974205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:34.974055    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-data\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.024220 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.024193    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"]
Oct 30 21:40:35.075867 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.075830    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istiod-ca-cert\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076061 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.075883    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-certs\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076061 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076026    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4268\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-kube-api-access-t4268\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076096    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-credential-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076170    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-envoy\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076236    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-token\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076319    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-podinfo\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076402 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076237    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-certs\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076402 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076365    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076402 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076391    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-data\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076553 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076437    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-credential-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.076667 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076644    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istiod-ca-cert\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.077155 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.076955    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.077460 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.077424    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-data\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.080801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.080769    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-podinfo\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.089749 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.089724    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-envoy\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.137516 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.137493    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4268\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-kube-api-access-t4268\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.137629 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.137589    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-token\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.232457 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.232390    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:35.664031 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.664008    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"]
Oct 30 21:40:35.665260 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:40:35.665235    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b29f70_02f7_4ccf_adc1_d3562ad5a3e4.slice/crio-a37b23e0e1c02ef03c8c68afdcb94e038bd8379da4d2b103ac11ecd44332170f WatchSource:0}: Error finding container a37b23e0e1c02ef03c8c68afdcb94e038bd8379da4d2b103ac11ecd44332170f: Status 404 returned error can't find the container with id a37b23e0e1c02ef03c8c68afdcb94e038bd8379da4d2b103ac11ecd44332170f
Oct 30 21:40:35.667689 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.667658    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:35.667771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.667721    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:35.667771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:35.667749    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:36.338727 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:36.338684    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" event={"ID":"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4","Type":"ContainerStarted","Data":"426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872"}
Oct 30 21:40:36.339265 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:36.338746    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" event={"ID":"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4","Type":"ContainerStarted","Data":"a37b23e0e1c02ef03c8c68afdcb94e038bd8379da4d2b103ac11ecd44332170f"}
Oct 30 21:40:36.462868 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:36.462811    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" podStartSLOduration=2.462793679 podStartE2EDuration="2.462793679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:36.459295254 +0000 UTC m=+1037.491143784" watchObservedRunningTime="2026-10-30 21:40:36.462793679 +0000 UTC m=+1037.494642214"
Oct 30 21:40:36.535511 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:36.535468    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:37.233994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:37.232892    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:37.234825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:37.234790    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:40:37.235002 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:37.234847    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:40:38.233991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:38.233357    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:40:38.233991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:38.233415    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:40:39.235991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:39.235043    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:40:39.235991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:39.235246    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:40:40.236994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:40.234360    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:40:40.236994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:40.234425    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:40:41.237346 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:41.237292    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:40:41.237820 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:41.237359    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:40:41.605174 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:41.605085    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:42.371245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:42.371210    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:42.371940 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:42.371919    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:42.374297 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:42.374275    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:40:42.394013 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:42.393994    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:42.410046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:42.410023    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:43.409258 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:43.409221    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:40:46.350087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:46.350054    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:46.868666 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:46.868628    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:51.764062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:51.764028    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:53.487888 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:40:53.487822    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:40:56.655559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:40:56.655494    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:01.542134 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:01.542098    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:01.710487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:01.710451    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:06.860193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:06.860134    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:10.981698 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:10.981667    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"]
Oct 30 21:41:10.985960 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:10.985935    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.086208 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.086166    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:11.086414 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.086393    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/690910f5-0d9c-4dab-8de0-1eed27769236-tls-certs\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.086463 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.086433    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-tmp-dir\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.086516 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.086504    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-home\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.086585 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.086570    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrkn\" (UniqueName: \"kubernetes.io/projected/690910f5-0d9c-4dab-8de0-1eed27769236-kube-api-access-pqrkn\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.086681 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.086664    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-model-cache\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.086728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.086714    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-dshm\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.090250 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.090228    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-6ea374\"/\"kube-root-ca.crt\""
Oct 30 21:41:11.090394 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.090332    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-6ea374\"/\"openshift-service-ca.crt\""
Oct 30 21:41:11.090554 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.090533    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-6ea374\"/\"distinct-w1-6ea374-kserve-self-signed-certs\""
Oct 30 21:41:11.090598 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.090588    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-6ea374\"/\"default-dockercfg-pm68c\""
Oct 30 21:41:11.094042 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.094025    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"]
Oct 30 21:41:11.188352 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.188307    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/690910f5-0d9c-4dab-8de0-1eed27769236-tls-certs\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.188352 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.188357    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-tmp-dir\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.188579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.188384    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-home\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.188579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.188430    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrkn\" (UniqueName: \"kubernetes.io/projected/690910f5-0d9c-4dab-8de0-1eed27769236-kube-api-access-pqrkn\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.188579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.188507    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-model-cache\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.188579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.188548    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-dshm\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.188874 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.188855    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-tmp-dir\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.188949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.188890    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-home\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.188949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.188916    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-model-cache\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.190910 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.190881    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-dshm\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.191229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.191213    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/690910f5-0d9c-4dab-8de0-1eed27769236-tls-certs\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.250860 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.250793    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrkn\" (UniqueName: \"kubernetes.io/projected/690910f5-0d9c-4dab-8de0-1eed27769236-kube-api-access-pqrkn\") pod \"distinct-w1-6ea374-kserve-55b6ff7866-qbhnh\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") " pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.299016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.298937    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:11.680161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.680125    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:11.689953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:11.689927    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"]
Oct 30 21:41:11.691144 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:41:11.691120    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod690910f5_0d9c_4dab_8de0_1eed27769236.slice/crio-d7b9abcab29954a7df51fc3e7e622365a80ecb1dcbe6550e0b588358dd4238e3 WatchSource:0}: Error finding container d7b9abcab29954a7df51fc3e7e622365a80ecb1dcbe6550e0b588358dd4238e3: Status 404 returned error can't find the container with id d7b9abcab29954a7df51fc3e7e622365a80ecb1dcbe6550e0b588358dd4238e3
Oct 30 21:41:12.627923 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:12.627888    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" event={"ID":"690910f5-0d9c-4dab-8de0-1eed27769236","Type":"ContainerStarted","Data":"54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5"}
Oct 30 21:41:12.628379 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:12.627949    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" event={"ID":"690910f5-0d9c-4dab-8de0-1eed27769236","Type":"ContainerStarted","Data":"d7b9abcab29954a7df51fc3e7e622365a80ecb1dcbe6550e0b588358dd4238e3"}
Oct 30 21:41:12.747580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:12.747531    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podStartSLOduration=2.747517643 podStartE2EDuration="2.747517643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:41:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:41:12.747127197 +0000 UTC m=+1073.778975733" watchObservedRunningTime="2026-10-30 21:41:12.747517643 +0000 UTC m=+1073.779366178"
Oct 30 21:41:13.299147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:13.299116    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:16.653437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:16.653397    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:16.827186 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:16.827153    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:21.046228 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.046193    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"]
Oct 30 21:41:21.050758 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.050739    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.123725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.123695    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-token\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.123834 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.123732    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b47c1-8101-4b4c-9504-2fffb1cee382-istiod-ca-cert\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.123890 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.123858    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-envoy\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.123940 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.123912    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-podinfo\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.124031 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.123992    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.124031 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.124019    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-credential-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.124150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.124039    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-certs\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.124229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.124207    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr29h\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-kube-api-access-vr29h\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.124296 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.124255    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-data\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.152796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.152770    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"]
Oct 30 21:41:21.225539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.225506    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-envoy\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.225712 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.225625    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-podinfo\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.225712 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.225662    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.225712 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.225699    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-credential-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.225881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.225730    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-certs\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.225881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.225833    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr29h\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-kube-api-access-vr29h\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.225881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.225886    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-data\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.226092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.225939    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-token\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.226092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.225981    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b47c1-8101-4b4c-9504-2fffb1cee382-istiod-ca-cert\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.226252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.226173    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-credential-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.226499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.226475    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-certs\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.226742 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.226723    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b47c1-8101-4b4c-9504-2fffb1cee382-istiod-ca-cert\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.226828 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.226755    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-data\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.227132 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.227111    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.228352 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.228324    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-envoy\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.229366 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.229343    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-podinfo\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.288137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.288111    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-token\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.288269 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.288179    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr29h\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-kube-api-access-vr29h\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.300053 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.299995    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:21.315886 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.315862    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:21.364088 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.364063    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:21.621072 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.620982    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:21.711766 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.711738    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:41:21.800401 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:41:21.800373    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398b47c1_8101_4b4c_9504_2fffb1cee382.slice/crio-05e12e1a5e235046669e9a18a768676b696da820968764bd2cced9ee5b247619 WatchSource:0}: Error finding container 05e12e1a5e235046669e9a18a768676b696da820968764bd2cced9ee5b247619: Status 404 returned error can't find the container with id 05e12e1a5e235046669e9a18a768676b696da820968764bd2cced9ee5b247619
Oct 30 21:41:21.801077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.801046    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"]
Oct 30 21:41:21.803681 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.803645    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:41:21.803792 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.803724    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:41:21.803792 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:21.803759    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:41:22.733786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:22.733748    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" event={"ID":"398b47c1-8101-4b4c-9504-2fffb1cee382","Type":"ContainerStarted","Data":"21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f"}
Oct 30 21:41:22.734283 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:22.733822    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" event={"ID":"398b47c1-8101-4b4c-9504-2fffb1cee382","Type":"ContainerStarted","Data":"05e12e1a5e235046669e9a18a768676b696da820968764bd2cced9ee5b247619"}
Oct 30 21:41:22.857351 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:22.857301    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" podStartSLOduration=2.8572869450000002 podStartE2EDuration="2.857286945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:41:22.854395583 +0000 UTC m=+1083.886244119" watchObservedRunningTime="2026-10-30 21:41:22.857286945 +0000 UTC m=+1083.889135479"
Oct 30 21:41:23.364325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:23.364290    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:23.365498 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:23.365475    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:41:23.365594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:23.365519    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:41:23.486858 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:41:23.486827    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:41:24.364719 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:24.364674    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:41:24.365294 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:24.364749    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:41:25.364907 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:25.364864    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:41:25.365324 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:25.364921    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:41:26.364384 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:26.364346    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:41:26.364587 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:26.364403    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:41:26.562369 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:26.562281    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:26.725647 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:26.725616    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:27.365396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:27.365363    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:41:27.365594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:27.365421    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:41:28.364784 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:28.364747    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:41:28.365207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:28.364811    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:41:29.369088 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:29.369014    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:29.369483 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:29.369461    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:29.370240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:29.370218    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:41:31.384475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:31.384402    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:36.323775 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:36.323743    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:37.636757 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:37.636718    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:40.798290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:40.798254    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:41.172918 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:41.172889    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:44.930123 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:44.930091    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:46.288628 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:46.288587    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:46.685236 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:46.685204    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:51.172003 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:51.171946    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:53.485893 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:41:53.485858    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:41:56.109003 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:41:56.108935    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:00.413825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.413793    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"]
Oct 30 21:42:00.418352 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.418334    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.535396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.535358    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.535396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.535399    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.535620 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.535423    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph4gq\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-kube-api-access-ph4gq\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.535620 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.535502    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.535696 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.535642    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.535696 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.535676    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.535894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.535871    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bf868ae-27c2-457a-a658-ce5dba1de494-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.536006 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.535914    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.536074 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.536031    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.631515 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.631482    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"]
Oct 30 21:42:00.637075 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.637042    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.637244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.637103    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.637244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.637128    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.637380 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.637303    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bf868ae-27c2-457a-a658-ce5dba1de494-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.637564 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.637503    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.637870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.637845    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.638118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.638087    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bf868ae-27c2-457a-a658-ce5dba1de494-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.638225 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.638136    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.638225 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.638164    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.638225 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.638213    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.638437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.638319    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.638437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.638353    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.638437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.638391    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph4gq\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-kube-api-access-ph4gq\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.639028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.638948    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.641037 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.640956    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.641321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.641295    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.700136 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.700057    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.700330 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.700305    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph4gq\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-kube-api-access-ph4gq\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.734572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.734544    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:00.894475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:00.894425    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:01.173184 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:01.173151    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"]
Oct 30 21:42:01.173349 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:42:01.173328    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf868ae_27c2_457a_a658_ce5dba1de494.slice/crio-b3e3a9afde8a5d039aa1c66306f33fe192049edc1dd09081017322f504632dec WatchSource:0}: Error finding container b3e3a9afde8a5d039aa1c66306f33fe192049edc1dd09081017322f504632dec: Status 404 returned error can't find the container with id b3e3a9afde8a5d039aa1c66306f33fe192049edc1dd09081017322f504632dec
Oct 30 21:42:01.175616 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:01.175585    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:42:01.175683 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:01.175649    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:42:01.175723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:01.175681    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:42:02.140786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:02.140749    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" event={"ID":"7bf868ae-27c2-457a-a658-ce5dba1de494","Type":"ContainerStarted","Data":"1d50d512c46bb9212fc97cb54840802e6022de8edb9fd8fae6aead1de4d8830f"}
Oct 30 21:42:02.141223 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:02.140805    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" event={"ID":"7bf868ae-27c2-457a-a658-ce5dba1de494","Type":"ContainerStarted","Data":"b3e3a9afde8a5d039aa1c66306f33fe192049edc1dd09081017322f504632dec"}
Oct 30 21:42:02.334667 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:02.334587    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" podStartSLOduration=2.334563037 podStartE2EDuration="2.334563037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:02.327028671 +0000 UTC m=+1123.358877208" watchObservedRunningTime="2026-10-30 21:42:02.334563037 +0000 UTC m=+1123.366411573"
Oct 30 21:42:02.736721 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:02.735296    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:02.738877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:02.737986    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:42:02.738877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:02.738053    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:42:03.735447 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:03.735417    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:42:03.735841 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:03.735472    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:42:04.737425 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:04.737385    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:42:04.738054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:04.738024    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:42:05.735329 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:05.735289    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:42:05.736039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:05.735611    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:42:05.992160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:05.992071    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:06.735369 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:06.735330    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:42:06.735680 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:06.735647    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:42:07.735592 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:07.735559    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:42:07.736008 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:07.735616    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:42:08.740796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:08.740769    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:08.741227 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:08.741089    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:08.741900 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:08.741877    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:42:10.964424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:10.964387    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:12.235570 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.235539    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"]
Oct 30 21:42:12.239641 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.239625    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.314678 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.314640    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-d68156\"/\"openshift-service-ca.crt\""
Oct 30 21:42:12.323482 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.323445    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-model-cache\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.323658 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.323504    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tls-certs\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.323658 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.323650    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tmp-dir\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.323793 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.323755    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzmv6\" (UniqueName: \"kubernetes.io/projected/79a164f9-2c90-4e69-9e69-33ae76c94a5c-kube-api-access-gzmv6\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.323853 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.323841    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-home\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.324018 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.323986    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-dshm\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.343192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.343171    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-d68156\"/\"kube-root-ca.crt\""
Oct 30 21:42:12.343311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.343253    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-d68156\"/\"distinct-2-w3-d68156-kserve-self-signed-certs\""
Oct 30 21:42:12.343311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.343282    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-d68156\"/\"default-dockercfg-h647m\""
Oct 30 21:42:12.348193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.348173    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"]
Oct 30 21:42:12.360368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.360347    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:12.425062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.425030    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-model-cache\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.425257 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.425073    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tls-certs\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.425257 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.425142    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tmp-dir\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.425257 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.425219    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzmv6\" (UniqueName: \"kubernetes.io/projected/79a164f9-2c90-4e69-9e69-33ae76c94a5c-kube-api-access-gzmv6\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.425424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.425279    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-home\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.425424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.425378    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-dshm\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.425528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.425476    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-model-cache\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.425577 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.425532    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tmp-dir\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.425821 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.425778    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-home\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.427698 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.427675    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-dshm\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.427882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.427861    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tls-certs\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.492207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.492125    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzmv6\" (UniqueName: \"kubernetes.io/projected/79a164f9-2c90-4e69-9e69-33ae76c94a5c-kube-api-access-gzmv6\") pod \"distinct-2-w3-d68156-kserve-68d4484bb7-gssdm\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") " pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.552776 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.552731    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:12.955870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:12.955839    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"]
Oct 30 21:42:12.956450 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:42:12.956425    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79a164f9_2c90_4e69_9e69_33ae76c94a5c.slice/crio-b82ea8a3a9a8532d56916474c659d3275f944d7b4104e4af6e62c478a55b89c2 WatchSource:0}: Error finding container b82ea8a3a9a8532d56916474c659d3275f944d7b4104e4af6e62c478a55b89c2: Status 404 returned error can't find the container with id b82ea8a3a9a8532d56916474c659d3275f944d7b4104e4af6e62c478a55b89c2
Oct 30 21:42:13.223399 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:13.223313    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" event={"ID":"79a164f9-2c90-4e69-9e69-33ae76c94a5c","Type":"ContainerStarted","Data":"456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969"}
Oct 30 21:42:13.223399 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:13.223358    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" event={"ID":"79a164f9-2c90-4e69-9e69-33ae76c94a5c","Type":"ContainerStarted","Data":"b82ea8a3a9a8532d56916474c659d3275f944d7b4104e4af6e62c478a55b89c2"}
Oct 30 21:42:13.347558 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:13.347499    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podStartSLOduration=1.347481717 podStartE2EDuration="1.347481717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:13.344072562 +0000 UTC m=+1134.375921100" watchObservedRunningTime="2026-10-30 21:42:13.347481717 +0000 UTC m=+1134.379330252"
Oct 30 21:42:13.553677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:13.553594    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:16.006849 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:16.006745    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:20.868405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:20.868361    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:22.553715 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:22.553682    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:22.566731 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:22.566706    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:23.305480 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:23.305455    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:42:23.491695 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:42:23.491663    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:42:25.794205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:25.794171    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:30.709743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:30.709704    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:35.695728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:35.695691    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:40.533241 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:40.533211    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:42.884730 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:42.884694    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:43.057112 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:43.057079    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:45.572405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:45.572365    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:47.060470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:47.060433    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:50.587394 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:50.587364    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:50.896199 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:50.896165    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:53.486278 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:42:53.486243    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:42:55.678700 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:42:55.678667    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:00.658287 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:00.657215    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:01.271716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.271684    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"]
Oct 30 21:43:01.276095 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.276079    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.348521 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.348479    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw4sb\" (UniqueName: \"kubernetes.io/projected/4342e3b8-2517-4bb3-88d9-37b5baca971b-kube-api-access-xw4sb\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.348725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.348635    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-dshm\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.348793 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.348727    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-home\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.348793 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.348743    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4342e3b8-2517-4bb3-88d9-37b5baca971b-tls-certs\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.348793 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.348766    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-model-cache\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.348952 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.348872    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-tmp-dir\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.379543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.379512    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-c7d477\"/\"distinct-2-w5-c7d477-kserve-self-signed-certs\""
Oct 30 21:43:01.383115 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.383093    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"]
Oct 30 21:43:01.395238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.395212    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:01.452316 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.452286    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-home\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.452537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.452513    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4342e3b8-2517-4bb3-88d9-37b5baca971b-tls-certs\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.452620 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.452565    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-model-cache\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.452704 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.452689    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-tmp-dir\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.452778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.452764    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw4sb\" (UniqueName: \"kubernetes.io/projected/4342e3b8-2517-4bb3-88d9-37b5baca971b-kube-api-access-xw4sb\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.452907 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.452883    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-dshm\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.453868 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.453810    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-model-cache\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.454118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.454097    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-home\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.454517 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.454487    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-tmp-dir\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.460294 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.460269    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-dshm\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.460803 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.460780    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4342e3b8-2517-4bb3-88d9-37b5baca971b-tls-certs\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.521361 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.521331    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw4sb\" (UniqueName: \"kubernetes.io/projected/4342e3b8-2517-4bb3-88d9-37b5baca971b-kube-api-access-xw4sb\") pod \"distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") " pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.588671 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.588582    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:01.988945 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:01.988921    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"]
Oct 30 21:43:01.990039 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:43:01.990015    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4342e3b8_2517_4bb3_88d9_37b5baca971b.slice/crio-5b2c476f344841017f276509b1b51f4e35f8ec0ef6f8ab8aa575035b103da2ec WatchSource:0}: Error finding container 5b2c476f344841017f276509b1b51f4e35f8ec0ef6f8ab8aa575035b103da2ec: Status 404 returned error can't find the container with id 5b2c476f344841017f276509b1b51f4e35f8ec0ef6f8ab8aa575035b103da2ec
Oct 30 21:43:02.608988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:02.608942    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" event={"ID":"4342e3b8-2517-4bb3-88d9-37b5baca971b","Type":"ContainerStarted","Data":"9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee"}
Oct 30 21:43:02.609178 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:02.609007    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" event={"ID":"4342e3b8-2517-4bb3-88d9-37b5baca971b","Type":"ContainerStarted","Data":"5b2c476f344841017f276509b1b51f4e35f8ec0ef6f8ab8aa575035b103da2ec"}
Oct 30 21:43:02.727075 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:02.727021    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podStartSLOduration=1.727007883 podStartE2EDuration="1.727007883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:02.726797925 +0000 UTC m=+1183.758646469" watchObservedRunningTime="2026-10-30 21:43:02.727007883 +0000 UTC m=+1183.758856419"
Oct 30 21:43:03.588756 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:03.588724    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:05.550603 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:05.550562    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:10.466841 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:10.466808    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:11.588870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:11.588834    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:11.603304 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:11.603278    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:11.703293 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:11.703251    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:43:15.382325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:15.382275    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:19.252034 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:19.251951    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:19.367811 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:19.367779    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:43:19.369856 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:19.369836    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:43:19.383286 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:19.383264    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:43:19.385332 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:19.385315    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:43:20.415752 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:20.415706    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:22.598932 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.598898    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"]
Oct 30 21:43:22.603539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.603519    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.684879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.684843    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-token\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.685060 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.684893    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-credential-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.685060 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.684992    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9qb8\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-kube-api-access-z9qb8\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.685151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.685129    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istiod-ca-cert\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.685187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.685162    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-podinfo\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.685220 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.685202    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.685285 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.685268    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-certs\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.685321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.685309    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-data\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.685442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.685399    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-envoy\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.712469 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.712436    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"]
Oct 30 21:43:22.786700 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.786670    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-envoy\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.786888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.786728    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-token\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.786888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.786758    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-credential-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.786888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.786782    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9qb8\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-kube-api-access-z9qb8\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.786888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.786851    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istiod-ca-cert\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.786888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.786882    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-podinfo\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.787228 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.786941    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.787228 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.787007    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-certs\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.787228 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.787043    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-data\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.787421 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.787353    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-certs\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.787489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.787418    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-credential-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.787489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.787446    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.787489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.787476    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-data\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.787884 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.787861    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istiod-ca-cert\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.789450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.789425    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-envoy\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.789910 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.789870    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-podinfo\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.848837 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.848808    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9qb8\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-kube-api-access-z9qb8\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.849030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.848839    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-token\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:22.918166 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:22.918135    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:23.352618 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:23.352588    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"]
Oct 30 21:43:23.353373 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:43:23.353331    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683905be_f8c6_4fe7_a065_f1c1fb4b0d3d.slice/crio-df30e4be9bd71fe8835f9fd9640ddb4a57ad882486e2df13c2cfcc95670ff978 WatchSource:0}: Error finding container df30e4be9bd71fe8835f9fd9640ddb4a57ad882486e2df13c2cfcc95670ff978: Status 404 returned error can't find the container with id df30e4be9bd71fe8835f9fd9640ddb4a57ad882486e2df13c2cfcc95670ff978
Oct 30 21:43:23.356049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:23.356018    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:43:23.356136 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:23.356087    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:43:23.356136 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:23.356117    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:43:23.504166 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:43:23.504132    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:43:23.794240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:23.794203    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" event={"ID":"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d","Type":"ContainerStarted","Data":"96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64"}
Oct 30 21:43:23.794677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:23.794274    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" event={"ID":"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d","Type":"ContainerStarted","Data":"df30e4be9bd71fe8835f9fd9640ddb4a57ad882486e2df13c2cfcc95670ff978"}
Oct 30 21:43:23.935086 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:23.919645    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" podStartSLOduration=1.919626101 podStartE2EDuration="1.919626101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:23.917142548 +0000 UTC m=+1204.948991092" watchObservedRunningTime="2026-10-30 21:43:23.919626101 +0000 UTC m=+1204.951474631"
Oct 30 21:43:23.935086 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:23.931448    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:24.927992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:24.924215    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:43:24.927992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:24.924276    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:43:25.597064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:25.597023    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:25.923991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:25.919340    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:43:25.923991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:25.919402    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:43:26.928990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:26.925277    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:43:26.928990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:26.925339    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:43:27.928989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:27.928053    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:43:27.928989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:27.928116    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:43:28.927988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:28.922275    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:43:28.927988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:28.922345    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:43:29.754494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:29.754448    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:29.919346 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:29.919305    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:43:29.919520 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:29.919370    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:43:30.631769 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:30.631728    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:30.923663 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:30.923562    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:30.924336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:30.924308    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:30.925163 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:30.925135    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:43:34.302666 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:34.302639    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:35.566389 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:35.566356    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:40.467931 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:40.467896    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:45.631542 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:45.631505    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:47.434276 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:47.434225    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:50.577333 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:50.577300    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:53.487319 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:43:53.487277    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:43:54.480524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:54.480487    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:55.684398 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:43:55.684370    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:00.570084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:00.570032    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:05.467768 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:05.467731    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:10.429285 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:10.429249    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:15.281662 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:15.281624    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:20.302403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:20.302363    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:23.487227 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:44:23.487186    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:44:25.288506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:25.288475    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:30.176552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:30.176457    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:35.079382 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:35.079352    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:37.219076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.219043    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"]
Oct 30 21:44:37.223198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.223181    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.273449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.273422    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.273586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.273453    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.273586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.273493    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.273676 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.273646    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.273730 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.273704    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j459j\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-kube-api-access-j459j\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.273806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.273784    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.273891 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.273876    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.273976 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.273945    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.274057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.274035    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.331860 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.331831    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"]
Oct 30 21:44:37.375459 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375433    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.375613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375485    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j459j\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-kube-api-access-j459j\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.375613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375510    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.375613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375547    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.375613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375577    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.375613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375619    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.375899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375682    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.375899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375704    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.375899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375763    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.375899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.375870    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.376186 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.376113    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.376242 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.376202    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.376242 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.376220    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.376462 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.376438    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.378903 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.378883    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.379096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.379081    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.436997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.436934    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.437141 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.437003    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j459j\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-kube-api-access-j459j\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.538003 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.537907    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:37.978721 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.978698    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"]
Oct 30 21:44:37.979101 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:44:37.979080    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bcd6d2_f075_47d4_8353_ed43b6b1f27a.slice/crio-40ffe2106980dcc9308d6e9a800c0533884436059f6970b397a1ea677d29c7af WatchSource:0}: Error finding container 40ffe2106980dcc9308d6e9a800c0533884436059f6970b397a1ea677d29c7af: Status 404 returned error can't find the container with id 40ffe2106980dcc9308d6e9a800c0533884436059f6970b397a1ea677d29c7af
Oct 30 21:44:37.981950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.981921    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:44:37.982059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.982006    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:44:37.982059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:37.982037    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:44:38.476023 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:38.475991    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" event={"ID":"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a","Type":"ContainerStarted","Data":"9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824"}
Oct 30 21:44:38.476487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:38.476046    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" event={"ID":"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a","Type":"ContainerStarted","Data":"40ffe2106980dcc9308d6e9a800c0533884436059f6970b397a1ea677d29c7af"}
Oct 30 21:44:38.538154 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:38.538126    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:38.697534 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:38.697489    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" podStartSLOduration=1.697474951 podStartE2EDuration="1.697474951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:38.647086389 +0000 UTC m=+1279.678934926" watchObservedRunningTime="2026-10-30 21:44:38.697474951 +0000 UTC m=+1279.729323486"
Oct 30 21:44:39.540228 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:39.540188    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:44:39.540694 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:39.540254    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:44:40.047441 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:40.047409    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:40.391989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:40.388845    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:40.538360 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:40.538330    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:44:40.538537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:40.538379    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:44:40.540062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:40.540021    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:41.538374 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:41.538339    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:44:41.538806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:41.538404    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:44:42.538696 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:42.538608    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:44:42.538696 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:42.538661    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:44:43.555562 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:43.554825    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:44:43.555562 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:43.554887    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:44:44.538405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:44.538352    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:44:44.538691 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:44.538661    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:44:45.171071 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:45.171037    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:45.539199 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:45.539110    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:44:45.539377 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:45.539225    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:44:46.782586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:46.782550    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"]
Oct 30 21:44:46.783175 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:46.782748    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy" containerID="cri-o://ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e" gracePeriod=30
Oct 30 21:44:47.162279 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:47.162250    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:47.162777 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:47.162751    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:47.163627 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:47.163609    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:44:47.756629 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:47.756592    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:50.085424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:50.085393    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:51.637388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.637345    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"]
Oct 30 21:44:51.644005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.643960    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.728935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.728903    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"]
Oct 30 21:44:51.741778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.741749    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-data\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.741934 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.741811    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-certs\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.742025 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.741919    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-token\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.742076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.742024    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-credential-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.742076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.742067    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddzqz\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-kube-api-access-ddzqz\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.742207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.742193    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-podinfo\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.742275 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.742265    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.742318 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.742285    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-envoy\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.742318 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.742305    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cbca6-4b1a-403a-856e-1f73b28431d3-istiod-ca-cert\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843218    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-data\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843364 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843264    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-certs\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843364 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843281    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-token\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843364 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843313    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-credential-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843364 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843343    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddzqz\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-kube-api-access-ddzqz\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843381    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-podinfo\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843454    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843479    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-envoy\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843513    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cbca6-4b1a-403a-856e-1f73b28431d3-istiod-ca-cert\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843749 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843674    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-data\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843749 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843730    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-certs\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.843904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843866    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-credential-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.844022 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.843932    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-socket\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.844282 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.844257    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cbca6-4b1a-403a-856e-1f73b28431d3-istiod-ca-cert\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.845998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.845956    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-podinfo\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.846110 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.845999    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-envoy\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.905107 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.905082    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-token\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.905578 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.905552    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddzqz\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-kube-api-access-ddzqz\") pod \"e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") " pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:51.959667 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:51.959581    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:52.069603 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.069568    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:44:52.147475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147383    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/89732d10-f523-4a3e-90f4-f01a95f99bfb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89732d10-f523-4a3e-90f4-f01a95f99bfb-istiod-ca-cert\") pod \"89732d10-f523-4a3e-90f4-f01a95f99bfb\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") "
Oct 30 21:44:52.147475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147427    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-certs\") pod \"89732d10-f523-4a3e-90f4-f01a95f99bfb\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") "
Oct 30 21:44:52.147711 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147486    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-envoy\") pod \"89732d10-f523-4a3e-90f4-f01a95f99bfb\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") "
Oct 30 21:44:52.147711 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147554    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-token\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-token\") pod \"89732d10-f523-4a3e-90f4-f01a95f99bfb\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") "
Oct 30 21:44:52.147711 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147595    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-kube-api-access-wk5r6\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-kube-api-access-wk5r6\") pod \"89732d10-f523-4a3e-90f4-f01a95f99bfb\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") "
Oct 30 21:44:52.147899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147720    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-credential-socket\") pod \"89732d10-f523-4a3e-90f4-f01a95f99bfb\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") "
Oct 30 21:44:52.147899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147783    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-socket\") pod \"89732d10-f523-4a3e-90f4-f01a95f99bfb\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") "
Oct 30 21:44:52.147899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147848    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-certs" pod "89732d10-f523-4a3e-90f4-f01a95f99bfb" (UID: "89732d10-f523-4a3e-90f4-f01a95f99bfb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:52.147899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147847    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89732d10-f523-4a3e-90f4-f01a95f99bfb-istiod-ca-cert" pod "89732d10-f523-4a3e-90f4-f01a95f99bfb" (UID: "89732d10-f523-4a3e-90f4-f01a95f99bfb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:52.147899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147859    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-data\") pod \"89732d10-f523-4a3e-90f4-f01a95f99bfb\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") "
Oct 30 21:44:52.148243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.147959    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-podinfo\") pod \"89732d10-f523-4a3e-90f4-f01a95f99bfb\" (UID: \"89732d10-f523-4a3e-90f4-f01a95f99bfb\") "
Oct 30 21:44:52.148243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.148124    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-credential-socket" pod "89732d10-f523-4a3e-90f4-f01a95f99bfb" (UID: "89732d10-f523-4a3e-90f4-f01a95f99bfb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:52.148957 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.148472    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-socket" pod "89732d10-f523-4a3e-90f4-f01a95f99bfb" (UID: "89732d10-f523-4a3e-90f4-f01a95f99bfb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:52.148957 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.148633    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-data" pod "89732d10-f523-4a3e-90f4-f01a95f99bfb" (UID: "89732d10-f523-4a3e-90f4-f01a95f99bfb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:52.149579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.149121    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:52.149579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.149145    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:52.149579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.149160    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:52.149579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.149175    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89732d10-f523-4a3e-90f4-f01a95f99bfb-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:52.149579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.149189    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:52.151342 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.151318    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-token" pod "89732d10-f523-4a3e-90f4-f01a95f99bfb" (UID: "89732d10-f523-4a3e-90f4-f01a95f99bfb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:52.152390 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.152360    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-envoy" pod "89732d10-f523-4a3e-90f4-f01a95f99bfb" (UID: "89732d10-f523-4a3e-90f4-f01a95f99bfb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:52.152476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.152423    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-podinfo" pod "89732d10-f523-4a3e-90f4-f01a95f99bfb" (UID: "89732d10-f523-4a3e-90f4-f01a95f99bfb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:44:52.153933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.153902    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-kube-api-access-wk5r6" pod "89732d10-f523-4a3e-90f4-f01a95f99bfb" (UID: "89732d10-f523-4a3e-90f4-f01a95f99bfb"). InnerVolumeSpecName "kube-api-access-wk5r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:52.251539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.251199    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:52.251539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.251240    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:52.251539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.251257    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk5r6\" (UniqueName: \"kubernetes.io/projected/89732d10-f523-4a3e-90f4-f01a95f99bfb-kube-api-access-wk5r6\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:52.251539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.251271    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89732d10-f523-4a3e-90f4-f01a95f99bfb-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:52.431122 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.431092    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"]
Oct 30 21:44:52.432009 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:44:52.431951    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773cbca6_4b1a_403a_856e_1f73b28431d3.slice/crio-452711b397709186b026e4e8078f95a9174b22cc78b03f73d5682ed204c71d7b WatchSource:0}: Error finding container 452711b397709186b026e4e8078f95a9174b22cc78b03f73d5682ed204c71d7b: Status 404 returned error can't find the container with id 452711b397709186b026e4e8078f95a9174b22cc78b03f73d5682ed204c71d7b
Oct 30 21:44:52.434552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.434519    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:44:52.434665 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.434597    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:44:52.434665 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.434638    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:44:52.654624 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.654592    5575 generic.go:356] "Generic (PLEG): container finished" podID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerID="ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e" exitCode=0
Oct 30 21:44:52.655089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.654650    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"
Oct 30 21:44:52.655089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.654683    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" event={"ID":"89732d10-f523-4a3e-90f4-f01a95f99bfb","Type":"ContainerDied","Data":"ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e"}
Oct 30 21:44:52.655089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.654742    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j" event={"ID":"89732d10-f523-4a3e-90f4-f01a95f99bfb","Type":"ContainerDied","Data":"055b88504a1571d3394279c91132a2a3b03e74411c6ef5b84d58627fe080f773"}
Oct 30 21:44:52.655089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.654774    5575 scope.go:122] "RemoveContainer" containerID="ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e"
Oct 30 21:44:52.657220 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.657196    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" event={"ID":"773cbca6-4b1a-403a-856e-1f73b28431d3","Type":"ContainerStarted","Data":"1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703"}
Oct 30 21:44:52.657368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.657237    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" event={"ID":"773cbca6-4b1a-403a-856e-1f73b28431d3","Type":"ContainerStarted","Data":"452711b397709186b026e4e8078f95a9174b22cc78b03f73d5682ed204c71d7b"}
Oct 30 21:44:52.667540 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.667518    5575 scope.go:122] "RemoveContainer" containerID="ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e"
Oct 30 21:44:52.667816 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:44:52.667799    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e\": container with ID starting with ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e not found: ID does not exist" containerID="ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e"
Oct 30 21:44:52.667878 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.667824    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e"} err="failed to get container status \"ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e\": rpc error: code = NotFound desc = could not find container \"ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e\": container with ID starting with ad41c4328810523c57df445e6e2e21676a1096effd3d39fd2279dd1e1f5da24e not found: ID does not exist"
Oct 30 21:44:52.822784 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.822751    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"]
Oct 30 21:44:52.827785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.827760    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jl49j"]
Oct 30 21:44:52.945555 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.945493    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" podStartSLOduration=1.9454725750000001 podStartE2EDuration="1.945472575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:52.942856143 +0000 UTC m=+1293.974704682" watchObservedRunningTime="2026-10-30 21:44:52.945472575 +0000 UTC m=+1293.977321110"
Oct 30 21:44:52.959701 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:52.959667    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:53.144645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:53.144610    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" path="/var/lib/kubelet/pods/89732d10-f523-4a3e-90f4-f01a95f99bfb/volumes"
Oct 30 21:44:53.488040 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:44:53.487926    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:44:53.961999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:53.961944    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:44:53.962385 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:53.962026    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:44:54.959909 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:54.959878    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:44:54.960109 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:54.959930    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:44:55.128992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:55.128524    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:55.960943 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:55.960907    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:44:55.961130 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:55.960981    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:44:56.961677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:56.960677    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:44:56.961677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:56.960746    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:44:57.960697 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:57.960651    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:44:57.960878 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:57.960746    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:44:58.960743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:58.960712    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:44:58.961181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:58.960762    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:44:59.964215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:59.964185    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:59.964676 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:59.964653    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:44:59.965447 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:44:59.965424    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:45:00.190991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.189901    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"]
Oct 30 21:45:00.190991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.190897    5575 cpu_manager.go:414] "containerMap: removing container" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy"
Oct 30 21:45:00.190991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.190916    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy"
Oct 30 21:45:00.191288 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.191148    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="89732d10-f523-4a3e-90f4-f01a95f99bfb" containerName="istio-proxy"
Oct 30 21:45:00.200244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.200217    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"]
Oct 30 21:45:00.203002 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.200327    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:00.205151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.205128    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:00.241908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.241883    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"]
Oct 30 21:45:00.273699 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.273385    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"]
Oct 30 21:45:00.301080 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.290184    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:00.337185 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.337070    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 21:45:00.386198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.386161    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twk8\" (UniqueName: \"kubernetes.io/projected/dc867708-9929-4cbd-bb8a-fb14856f23c3-kube-api-access-4twk8\") pod \"maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb\" (UID: \"dc867708-9929-4cbd-bb8a-fb14856f23c3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:00.386396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.386240    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc867708-9929-4cbd-bb8a-fb14856f23c3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb\" (UID: \"dc867708-9929-4cbd-bb8a-fb14856f23c3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:00.386396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.386285    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e1292b-5184-44dd-9af0-b12ff326536c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5\" (UID: \"25e1292b-5184-44dd-9af0-b12ff326536c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:00.386396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.386483    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rwrt\" (UniqueName: \"kubernetes.io/projected/25e1292b-5184-44dd-9af0-b12ff326536c-kube-api-access-8rwrt\") pod \"maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5\" (UID: \"25e1292b-5184-44dd-9af0-b12ff326536c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:00.487653 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.487568    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twk8\" (UniqueName: \"kubernetes.io/projected/dc867708-9929-4cbd-bb8a-fb14856f23c3-kube-api-access-4twk8\") pod \"maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb\" (UID: \"dc867708-9929-4cbd-bb8a-fb14856f23c3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:00.487653 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.487646    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc867708-9929-4cbd-bb8a-fb14856f23c3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb\" (UID: \"dc867708-9929-4cbd-bb8a-fb14856f23c3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:00.487893 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.487687    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e1292b-5184-44dd-9af0-b12ff326536c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5\" (UID: \"25e1292b-5184-44dd-9af0-b12ff326536c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:00.487893 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.487724    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rwrt\" (UniqueName: \"kubernetes.io/projected/25e1292b-5184-44dd-9af0-b12ff326536c-kube-api-access-8rwrt\") pod \"maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5\" (UID: \"25e1292b-5184-44dd-9af0-b12ff326536c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:00.488439 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.488415    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc867708-9929-4cbd-bb8a-fb14856f23c3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb\" (UID: \"dc867708-9929-4cbd-bb8a-fb14856f23c3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:00.488544 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.488500    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e1292b-5184-44dd-9af0-b12ff326536c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5\" (UID: \"25e1292b-5184-44dd-9af0-b12ff326536c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:00.549668 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.549635    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twk8\" (UniqueName: \"kubernetes.io/projected/dc867708-9929-4cbd-bb8a-fb14856f23c3-kube-api-access-4twk8\") pod \"maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb\" (UID: \"dc867708-9929-4cbd-bb8a-fb14856f23c3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:00.549902 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.549704    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rwrt\" (UniqueName: \"kubernetes.io/projected/25e1292b-5184-44dd-9af0-b12ff326536c-kube-api-access-8rwrt\") pod \"maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5\" (UID: \"25e1292b-5184-44dd-9af0-b12ff326536c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:00.826225 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.826143    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:00.839437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:00.839416    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:01.218482 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:01.218452    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"]
Oct 30 21:45:01.259833 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:01.259802    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e1292b_5184_44dd_9af0_b12ff326536c.slice/crio-e5394db99318a8b278cd14f267f0dec37360110a711236c067756e1195c821ee WatchSource:0}: Error finding container e5394db99318a8b278cd14f267f0dec37360110a711236c067756e1195c821ee: Status 404 returned error can't find the container with id e5394db99318a8b278cd14f267f0dec37360110a711236c067756e1195c821ee
Oct 30 21:45:01.274301 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:01.274277    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc867708_9929_4cbd_bb8a_fb14856f23c3.slice/crio-92804f88fa67200c8a0543ce5f47781a380c6204cf2ae9581c8f4b044d6ee832 WatchSource:0}: Error finding container 92804f88fa67200c8a0543ce5f47781a380c6204cf2ae9581c8f4b044d6ee832: Status 404 returned error can't find the container with id 92804f88fa67200c8a0543ce5f47781a380c6204cf2ae9581c8f4b044d6ee832
Oct 30 21:45:01.275415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:01.275390    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"]
Oct 30 21:45:01.730881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:01.730846    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" event={"ID":"25e1292b-5184-44dd-9af0-b12ff326536c","Type":"ContainerStarted","Data":"ca66ae7bcf8fc8f01d9126180b306775b9ac2b9f408a2483e92e288c129c19fa"}
Oct 30 21:45:01.731057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:01.730906    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" event={"ID":"25e1292b-5184-44dd-9af0-b12ff326536c","Type":"ContainerStarted","Data":"e5394db99318a8b278cd14f267f0dec37360110a711236c067756e1195c821ee"}
Oct 30 21:45:01.732491 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:01.732464    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb" event={"ID":"dc867708-9929-4cbd-bb8a-fb14856f23c3","Type":"ContainerStarted","Data":"92804f88fa67200c8a0543ce5f47781a380c6204cf2ae9581c8f4b044d6ee832"}
Oct 30 21:45:01.850878 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:01.850828    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" podStartSLOduration=1.850809674 podStartE2EDuration="1.850809674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:01.848090418 +0000 UTC m=+1302.879938953" watchObservedRunningTime="2026-10-30 21:45:01.850809674 +0000 UTC m=+1302.882658210"
Oct 30 21:45:01.914873 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:01.914834    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"]
Oct 30 21:45:01.915410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:01.915374    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy" containerID="cri-o://782ae492f934dffb053d7efe595e96ad3f1360540ec39cf125cead7be6cdd4db" gracePeriod=30
Oct 30 21:45:02.741568 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:02.741533    5575 generic.go:356] "Generic (PLEG): container finished" podID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerID="1b318efa8401ac6722d27e3033c602786ad3599639ec5f02fd8719edceed5e4a" exitCode=60
Oct 30 21:45:02.742059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:02.741613    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb" event={"ID":"dc867708-9929-4cbd-bb8a-fb14856f23c3","Type":"ContainerDied","Data":"1b318efa8401ac6722d27e3033c602786ad3599639ec5f02fd8719edceed5e4a"}
Oct 30 21:45:02.742059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:02.741906    5575 scope.go:122] "RemoveContainer" containerID="1b318efa8401ac6722d27e3033c602786ad3599639ec5f02fd8719edceed5e4a"
Oct 30 21:45:02.743593 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:02.743568    5575 generic.go:356] "Generic (PLEG): container finished" podID="25e1292b-5184-44dd-9af0-b12ff326536c" containerID="ca66ae7bcf8fc8f01d9126180b306775b9ac2b9f408a2483e92e288c129c19fa" exitCode=60
Oct 30 21:45:02.743711 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:02.743641    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" event={"ID":"25e1292b-5184-44dd-9af0-b12ff326536c","Type":"ContainerDied","Data":"ca66ae7bcf8fc8f01d9126180b306775b9ac2b9f408a2483e92e288c129c19fa"}
Oct 30 21:45:02.743885 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:02.743870    5575 scope.go:122] "RemoveContainer" containerID="ca66ae7bcf8fc8f01d9126180b306775b9ac2b9f408a2483e92e288c129c19fa"
Oct 30 21:45:03.755611 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:03.755576    5575 generic.go:356] "Generic (PLEG): container finished" podID="25e1292b-5184-44dd-9af0-b12ff326536c" containerID="8fe488287274a47a2413195c0438c277ce77860c9109e19ebb537b3bbe61a44f" exitCode=60
Oct 30 21:45:03.756062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:03.755617    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" event={"ID":"25e1292b-5184-44dd-9af0-b12ff326536c","Type":"ContainerDied","Data":"8fe488287274a47a2413195c0438c277ce77860c9109e19ebb537b3bbe61a44f"}
Oct 30 21:45:03.756062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:03.755703    5575 scope.go:122] "RemoveContainer" containerID="ca66ae7bcf8fc8f01d9126180b306775b9ac2b9f408a2483e92e288c129c19fa"
Oct 30 21:45:03.756062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:03.756006    5575 scope.go:122] "RemoveContainer" containerID="8fe488287274a47a2413195c0438c277ce77860c9109e19ebb537b3bbe61a44f"
Oct 30 21:45:03.756344 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:03.756321    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5_odh-ai-gateway-infra(25e1292b-5184-44dd-9af0-b12ff326536c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" podUID="25e1292b-5184-44dd-9af0-b12ff326536c"
Oct 30 21:45:03.758236 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:03.758217    5575 generic.go:356] "Generic (PLEG): container finished" podID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerID="54f42b65a4a85b097bf1b3f84a6d770304d3c5dd8293e01da83f3fa45a0e4ed5" exitCode=60
Oct 30 21:45:03.758321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:03.758264    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb" event={"ID":"dc867708-9929-4cbd-bb8a-fb14856f23c3","Type":"ContainerDied","Data":"54f42b65a4a85b097bf1b3f84a6d770304d3c5dd8293e01da83f3fa45a0e4ed5"}
Oct 30 21:45:03.758526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:03.758514    5575 scope.go:122] "RemoveContainer" containerID="54f42b65a4a85b097bf1b3f84a6d770304d3c5dd8293e01da83f3fa45a0e4ed5"
Oct 30 21:45:03.758787 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:03.758768    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb_odh-ai-gateway-infra(dc867708-9929-4cbd-bb8a-fb14856f23c3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3"
Oct 30 21:45:03.834897 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:03.834858    5575 scope.go:122] "RemoveContainer" containerID="1b318efa8401ac6722d27e3033c602786ad3599639ec5f02fd8719edceed5e4a"
Oct 30 21:45:04.767268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:04.767216    5575 scope.go:122] "RemoveContainer" containerID="54f42b65a4a85b097bf1b3f84a6d770304d3c5dd8293e01da83f3fa45a0e4ed5"
Oct 30 21:45:04.767750 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:04.767502    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb_odh-ai-gateway-infra(dc867708-9929-4cbd-bb8a-fb14856f23c3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3"
Oct 30 21:45:04.769102 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:04.769081    5575 scope.go:122] "RemoveContainer" containerID="8fe488287274a47a2413195c0438c277ce77860c9109e19ebb537b3bbe61a44f"
Oct 30 21:45:04.769293 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:04.769274    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5_odh-ai-gateway-infra(25e1292b-5184-44dd-9af0-b12ff326536c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" podUID="25e1292b-5184-44dd-9af0-b12ff326536c"
Oct 30 21:45:05.254371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:05.254330    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:06.899718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:06.899548    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"]
Oct 30 21:45:06.906747 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:06.906722    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:06.966688 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:06.966642    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"]
Oct 30 21:45:06.988999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:06.988941    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4caf4e3b-qxp9k\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:06.994991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:06.989246    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4caf4e3b-qxp9k\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:06.995385 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:06.995359    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs96x\" (UniqueName: \"kubernetes.io/projected/0e030c96-10cd-4593-8667-63f5f47e95f7-kube-api-access-gs96x\") pod \"maas-api-revoke-sub-4caf4e3b-qxp9k\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:07.018140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.018112    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:45:07.117001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.097855    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4caf4e3b-qxp9k\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:07.117001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.097939    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4caf4e3b-qxp9k\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:07.117001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.098146    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs96x\" (UniqueName: \"kubernetes.io/projected/0e030c96-10cd-4593-8667-63f5f47e95f7-kube-api-access-gs96x\") pod \"maas-api-revoke-sub-4caf4e3b-qxp9k\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:07.143022 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.120666    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4caf4e3b-qxp9k\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:07.143022 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.121416    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4caf4e3b-qxp9k\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:07.280045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.273865    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs96x\" (UniqueName: \"kubernetes.io/projected/0e030c96-10cd-4593-8667-63f5f47e95f7-kube-api-access-gs96x\") pod \"maas-api-revoke-sub-4caf4e3b-qxp9k\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:07.298990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.280321    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:07.711062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.711028    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"]
Oct 30 21:45:07.781337 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.781305    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"]
Oct 30 21:45:07.808859 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.808831    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:07.895045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.890419    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-credential-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:07.895045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.890503    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8144e9-393d-40d7-bb6b-38532daa080f-istiod-ca-cert\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:07.895045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.890554    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-certs\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:07.895045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.890609    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-envoy\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:07.895045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.890679    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:07.895045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.890711    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-token\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:07.895045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.890759    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w972\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-kube-api-access-6w972\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:07.895045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.890904    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-data\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:07.895045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:07.890940    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-podinfo\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.000927    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-podinfo\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.001108    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-credential-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.001178    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8144e9-393d-40d7-bb6b-38532daa080f-istiod-ca-cert\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.001224    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-certs\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.001298    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-envoy\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.001368    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.001397    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-token\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.001449    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w972\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-kube-api-access-6w972\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.001582    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-data\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.011214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.002107    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-data\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.134991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.069148    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8144e9-393d-40d7-bb6b-38532daa080f-istiod-ca-cert\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.134991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.069423    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-credential-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.134991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.069674    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-certs\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.134991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.070247    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-socket\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.134991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.086368    5575 generic.go:356] "Generic (PLEG): container finished" podID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerID="782ae492f934dffb053d7efe595e96ad3f1360540ec39cf125cead7be6cdd4db" exitCode=0
Oct 30 21:45:08.134991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.086556    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" event={"ID":"955aa6b9-e73c-49b0-84b6-238c381a2b87","Type":"ContainerDied","Data":"782ae492f934dffb053d7efe595e96ad3f1360540ec39cf125cead7be6cdd4db"}
Oct 30 21:45:08.161040 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.155881    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-podinfo\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.161040 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.159579    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-envoy\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.196991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.166075    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w972\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-kube-api-access-6w972\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.205637 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.205549    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-token\") pod \"e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") " pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.275230 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.275187    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:08.302579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.299574    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:08.426048 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.411287    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 21:45:08.509108 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.509060    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:08.612130 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.611063    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:45:08.737173 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.737074    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:45:08.737754 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.737723    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 21:45:08.803230 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.798002    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:45:08.817090 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.817053    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:45:08.817339 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.817315    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:08.980038 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:08.979996    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:45:09.308952 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:09.308906    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:09.476098 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:09.468070    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:09.704298 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:09.704259    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:45:09.806613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:09.806507    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:09.807445 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:09.807415    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:09.970096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:09.951652    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 21:45:10.011610 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:09.998494    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:10.063052 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:10.048596    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-77kb4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:45:10.063052 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:10.048670    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:10.301415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:10.296230    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:10.358176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:10.352457    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:45:10.655084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:10.654374    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:11.049574 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.049530    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:11.319823 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:11.319786    5575 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="2.111s"
Oct 30 21:45:11.556050 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.154212    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:11.707987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.186227    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:11.707987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.186257    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:11.707987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.090101    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:11.707987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.372424    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:45:11.707987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.373342    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:45:11.707987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.414214    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:11.707987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.707738    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:11.708493 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.708401    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:11.728997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.677040    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:11.728997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.414377    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761194    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"]
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761296    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761333    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761368    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761402    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761434    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761452    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"]
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761564    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761594    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761625    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761652    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.761679    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.771298    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-kube-api-access-vsz4v\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-kube-api-access-vsz4v\") pod \"955aa6b9-e73c-49b0-84b6-238c381a2b87\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") "
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.771364    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-credential-socket\") pod \"955aa6b9-e73c-49b0-84b6-238c381a2b87\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") "
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.771407    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-data\") pod \"955aa6b9-e73c-49b0-84b6-238c381a2b87\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") "
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.771463    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-certs\") pod \"955aa6b9-e73c-49b0-84b6-238c381a2b87\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") "
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.771501    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/955aa6b9-e73c-49b0-84b6-238c381a2b87-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/955aa6b9-e73c-49b0-84b6-238c381a2b87-istiod-ca-cert\") pod \"955aa6b9-e73c-49b0-84b6-238c381a2b87\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") "
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.771566    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-socket\") pod \"955aa6b9-e73c-49b0-84b6-238c381a2b87\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") "
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.771593    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-podinfo\") pod \"955aa6b9-e73c-49b0-84b6-238c381a2b87\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") "
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.771679    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-token\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-token\") pod \"955aa6b9-e73c-49b0-84b6-238c381a2b87\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") "
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.771736    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-envoy\") pod \"955aa6b9-e73c-49b0-84b6-238c381a2b87\" (UID: \"955aa6b9-e73c-49b0-84b6-238c381a2b87\") "
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.772923    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-socket" pod "955aa6b9-e73c-49b0-84b6-238c381a2b87" (UID: "955aa6b9-e73c-49b0-84b6-238c381a2b87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.773528    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/955aa6b9-e73c-49b0-84b6-238c381a2b87-istiod-ca-cert" pod "955aa6b9-e73c-49b0-84b6-238c381a2b87" (UID: "955aa6b9-e73c-49b0-84b6-238c381a2b87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.773538    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-data" pod "955aa6b9-e73c-49b0-84b6-238c381a2b87" (UID: "955aa6b9-e73c-49b0-84b6-238c381a2b87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.773732    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-credential-socket" pod "955aa6b9-e73c-49b0-84b6-238c381a2b87" (UID: "955aa6b9-e73c-49b0-84b6-238c381a2b87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:11.775528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.773782    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-certs" pod "955aa6b9-e73c-49b0-84b6-238c381a2b87" (UID: "955aa6b9-e73c-49b0-84b6-238c381a2b87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:11.777359 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.776530    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-token" pod "955aa6b9-e73c-49b0-84b6-238c381a2b87" (UID: "955aa6b9-e73c-49b0-84b6-238c381a2b87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:11.783591 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.783562    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-kube-api-access-vsz4v" pod "955aa6b9-e73c-49b0-84b6-238c381a2b87" (UID: "955aa6b9-e73c-49b0-84b6-238c381a2b87"). InnerVolumeSpecName "kube-api-access-vsz4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:11.783839 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.783822    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-envoy" pod "955aa6b9-e73c-49b0-84b6-238c381a2b87" (UID: "955aa6b9-e73c-49b0-84b6-238c381a2b87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:11.789984 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.786313    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-podinfo" pod "955aa6b9-e73c-49b0-84b6-238c381a2b87" (UID: "955aa6b9-e73c-49b0-84b6-238c381a2b87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:45:11.794984 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.793752    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:45:11.800983 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.797420    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:45:11.800983 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.799782    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:45:11.808033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.807467    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:45:11.811481 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.810581    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:45:11.824415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.821246    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:45:11.874383 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.874356    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:11.874541 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.874523    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsz4v\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-kube-api-access-vsz4v\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:11.874642 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.874628    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:11.874733 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.874714    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:11.874799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.874735    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:11.874799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.874749    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/955aa6b9-e73c-49b0-84b6-238c381a2b87-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:11.874799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.874764    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/955aa6b9-e73c-49b0-84b6-238c381a2b87-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:11.874799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.874778    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:11.874799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:11.874792    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/955aa6b9-e73c-49b0-84b6-238c381a2b87-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:12.358934 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:12.358904    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k" event={"ID":"0e030c96-10cd-4593-8667-63f5f47e95f7","Type":"ContainerStarted","Data":"88f58a56d3ee7ef6fda0691ee7a2a183127cc4ac87fa45c82926fbfba560513c"}
Oct 30 21:45:12.359157 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:12.358958    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k" event={"ID":"0e030c96-10cd-4593-8667-63f5f47e95f7","Type":"ContainerStarted","Data":"776413373eb62bc2affcfe0572a9b832268bcc7aa12b8e2209512f17a59a1d6e"}
Oct 30 21:45:12.360831 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:12.360803    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" event={"ID":"cb8144e9-393d-40d7-bb6b-38532daa080f","Type":"ContainerStarted","Data":"e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2"}
Oct 30 21:45:12.360993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:12.360852    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" event={"ID":"cb8144e9-393d-40d7-bb6b-38532daa080f","Type":"ContainerStarted","Data":"d6231446eb725fc221d231246515bd2f144d42e1df02846f91130f91d0740018"}
Oct 30 21:45:12.362301 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:12.362270    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"
Oct 30 21:45:12.362436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:12.362311    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4" event={"ID":"955aa6b9-e73c-49b0-84b6-238c381a2b87","Type":"ContainerDied","Data":"2511abba6cf05b6dc567d5f42b0e217cb9abf732924e2e94bad7183a7003fb6f"}
Oct 30 21:45:12.362436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:12.362360    5575 scope.go:122] "RemoveContainer" containerID="782ae492f934dffb053d7efe595e96ad3f1360540ec39cf125cead7be6cdd4db"
Oct 30 21:45:12.702745 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:12.702708    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:13.004025 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:13.003917    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" podStartSLOduration=6.003903924 podStartE2EDuration="6.003903924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:13.002366183 +0000 UTC m=+1314.034214717" watchObservedRunningTime="2026-10-30 21:45:13.003903924 +0000 UTC m=+1314.035752458"
Oct 30 21:45:13.148062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:13.148000    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k" podStartSLOduration=7.147982135 podStartE2EDuration="7.147982135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:13.138522869 +0000 UTC m=+1314.170371405" watchObservedRunningTime="2026-10-30 21:45:13.147982135 +0000 UTC m=+1314.179830663"
Oct 30 21:45:13.254784 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:13.254695    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"]
Oct 30 21:45:13.258247 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:13.258220    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-77kb4"]
Oct 30 21:45:13.280669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:13.280629    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:13.282117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:13.282095    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:45:13.282223 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:13.282141    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:45:13.372497 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:13.372467    5575 generic.go:356] "Generic (PLEG): container finished" podID="0e030c96-10cd-4593-8667-63f5f47e95f7" containerID="88f58a56d3ee7ef6fda0691ee7a2a183127cc4ac87fa45c82926fbfba560513c" exitCode=0
Oct 30 21:45:13.372668 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:13.372546    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k" event={"ID":"0e030c96-10cd-4593-8667-63f5f47e95f7","Type":"ContainerDied","Data":"88f58a56d3ee7ef6fda0691ee7a2a183127cc4ac87fa45c82926fbfba560513c"}
Oct 30 21:45:14.280616 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.280578    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:45:14.281024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.280639    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:45:14.343381 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.343343    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"]
Oct 30 21:45:14.344321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.344302    5575 cpu_manager.go:414] "containerMap: removing container" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy"
Oct 30 21:45:14.344379 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.344324    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy"
Oct 30 21:45:14.344521 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.344510    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" containerName="istio-proxy"
Oct 30 21:45:14.348780 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.348756    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.399849 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.399757    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"]
Oct 30 21:45:14.449864 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.449794    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fch9h\" (UniqueName: \"kubernetes.io/projected/54fb8140-12ac-4465-bd3b-c415968282c6-kube-api-access-fch9h\") pod \"maas-api-revoke-sub-334c8256-4dth5\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.450069 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.449897    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-334c8256-4dth5\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.450069 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.450015    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-334c8256-4dth5\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.555947 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.555278    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-334c8256-4dth5\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.556132 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.556048    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-334c8256-4dth5\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.556306 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.556273    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fch9h\" (UniqueName: \"kubernetes.io/projected/54fb8140-12ac-4465-bd3b-c415968282c6-kube-api-access-fch9h\") pod \"maas-api-revoke-sub-334c8256-4dth5\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.557336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.557311    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-334c8256-4dth5\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.561336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.561311    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-334c8256-4dth5\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.642513 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.642483    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fch9h\" (UniqueName: \"kubernetes.io/projected/54fb8140-12ac-4465-bd3b-c415968282c6-kube-api-access-fch9h\") pod \"maas-api-revoke-sub-334c8256-4dth5\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.665276 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.665252    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:14.666272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.666255    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:14.761717 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.761684    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e030c96-10cd-4593-8667-63f5f47e95f7-kube-api-access-gs96x\" (UniqueName: \"kubernetes.io/projected/0e030c96-10cd-4593-8667-63f5f47e95f7-kube-api-access-gs96x\") pod \"0e030c96-10cd-4593-8667-63f5f47e95f7\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") "
Oct 30 21:45:14.761827 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.761794    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-xks-ca\") pod \"0e030c96-10cd-4593-8667-63f5f47e95f7\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") "
Oct 30 21:45:14.761923 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.761899    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-openshift-ca\") pod \"0e030c96-10cd-4593-8667-63f5f47e95f7\" (UID: \"0e030c96-10cd-4593-8667-63f5f47e95f7\") "
Oct 30 21:45:14.763092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.762828    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-openshift-ca" pod "0e030c96-10cd-4593-8667-63f5f47e95f7" (UID: "0e030c96-10cd-4593-8667-63f5f47e95f7"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:14.765608 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.765582    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-xks-ca" pod "0e030c96-10cd-4593-8667-63f5f47e95f7" (UID: "0e030c96-10cd-4593-8667-63f5f47e95f7"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:14.766197 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.765784    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e030c96-10cd-4593-8667-63f5f47e95f7-kube-api-access-gs96x" pod "0e030c96-10cd-4593-8667-63f5f47e95f7" (UID: "0e030c96-10cd-4593-8667-63f5f47e95f7"). InnerVolumeSpecName "kube-api-access-gs96x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:14.867791 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.867693    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs96x\" (UniqueName: \"kubernetes.io/projected/0e030c96-10cd-4593-8667-63f5f47e95f7-kube-api-access-gs96x\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:14.867791 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.867718    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:14.867791 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:14.867728    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e030c96-10cd-4593-8667-63f5f47e95f7-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:15.093178 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:15.093148    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"]
Oct 30 21:45:15.093286 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:15.093146    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54fb8140_12ac_4465_bd3b_c415968282c6.slice/crio-e4c809fad629862459f626af0cea0652eff7fc45ff622ee487c248a8350c3fb3 WatchSource:0}: Error finding container e4c809fad629862459f626af0cea0652eff7fc45ff622ee487c248a8350c3fb3: Status 404 returned error can't find the container with id e4c809fad629862459f626af0cea0652eff7fc45ff622ee487c248a8350c3fb3
Oct 30 21:45:15.141833 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:15.141807    5575 scope.go:122] "RemoveContainer" containerID="54f42b65a4a85b097bf1b3f84a6d770304d3c5dd8293e01da83f3fa45a0e4ed5"
Oct 30 21:45:15.157875 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:15.157848    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="955aa6b9-e73c-49b0-84b6-238c381a2b87" path="/var/lib/kubelet/pods/955aa6b9-e73c-49b0-84b6-238c381a2b87/volumes"
Oct 30 21:45:15.280771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:15.280738    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:45:15.281181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:15.280791    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:45:15.388311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:15.388274    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k" event={"ID":"0e030c96-10cd-4593-8667-63f5f47e95f7","Type":"ContainerDied","Data":"776413373eb62bc2affcfe0572a9b832268bcc7aa12b8e2209512f17a59a1d6e"}
Oct 30 21:45:15.388453 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:15.388329    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="776413373eb62bc2affcfe0572a9b832268bcc7aa12b8e2209512f17a59a1d6e"
Oct 30 21:45:15.388453 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:15.388294    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"
Oct 30 21:45:15.389717 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:15.389649    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5" event={"ID":"54fb8140-12ac-4465-bd3b-c415968282c6","Type":"ContainerStarted","Data":"e4c809fad629862459f626af0cea0652eff7fc45ff622ee487c248a8350c3fb3"}
Oct 30 21:45:16.280402 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:16.280370    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:45:16.280540 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:16.280428    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:45:16.400369 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:16.400337    5575 generic.go:356] "Generic (PLEG): container finished" podID="54fb8140-12ac-4465-bd3b-c415968282c6" containerID="aaa76c3eb66e888902c9567ee4c40a82130fd48acfdf70f3ec4d5a03da60790b" exitCode=0
Oct 30 21:45:16.400717 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:16.400422    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5" event={"ID":"54fb8140-12ac-4465-bd3b-c415968282c6","Type":"ContainerDied","Data":"aaa76c3eb66e888902c9567ee4c40a82130fd48acfdf70f3ec4d5a03da60790b"}
Oct 30 21:45:16.402707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:16.402688    5575 generic.go:356] "Generic (PLEG): container finished" podID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerID="89e3aa976ff4482bd01c6826360bd8153bb7bd9c27b2f2266ed2eee7abd119ae" exitCode=60
Oct 30 21:45:16.402807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:16.402756    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb" event={"ID":"dc867708-9929-4cbd-bb8a-fb14856f23c3","Type":"ContainerDied","Data":"89e3aa976ff4482bd01c6826360bd8153bb7bd9c27b2f2266ed2eee7abd119ae"}
Oct 30 21:45:16.402880 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:16.402828    5575 scope.go:122] "RemoveContainer" containerID="54f42b65a4a85b097bf1b3f84a6d770304d3c5dd8293e01da83f3fa45a0e4ed5"
Oct 30 21:45:16.403235 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:16.403217    5575 scope.go:122] "RemoveContainer" containerID="89e3aa976ff4482bd01c6826360bd8153bb7bd9c27b2f2266ed2eee7abd119ae"
Oct 30 21:45:16.403559 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:16.403542    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb_odh-ai-gateway-infra(dc867708-9929-4cbd-bb8a-fb14856f23c3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3"
Oct 30 21:45:17.121001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.120487    5575 scope.go:122] "RemoveContainer" containerID="8fe488287274a47a2413195c0438c277ce77860c9109e19ebb537b3bbe61a44f"
Oct 30 21:45:17.280581 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.280547    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:45:17.280750 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.280603    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:45:17.670907 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.670875    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"]
Oct 30 21:45:17.685655 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.685613    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:17.804723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.804690    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-xks-ca\") pod \"54fb8140-12ac-4465-bd3b-c415968282c6\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") "
Oct 30 21:45:17.804905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.804762    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54fb8140-12ac-4465-bd3b-c415968282c6-kube-api-access-fch9h\" (UniqueName: \"kubernetes.io/projected/54fb8140-12ac-4465-bd3b-c415968282c6-kube-api-access-fch9h\") pod \"54fb8140-12ac-4465-bd3b-c415968282c6\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") "
Oct 30 21:45:17.804979 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.804916    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-openshift-ca\") pod \"54fb8140-12ac-4465-bd3b-c415968282c6\" (UID: \"54fb8140-12ac-4465-bd3b-c415968282c6\") "
Oct 30 21:45:17.805920 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.805895    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-openshift-ca" pod "54fb8140-12ac-4465-bd3b-c415968282c6" (UID: "54fb8140-12ac-4465-bd3b-c415968282c6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:17.863204 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.863163    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54fb8140-12ac-4465-bd3b-c415968282c6-kube-api-access-fch9h" pod "54fb8140-12ac-4465-bd3b-c415968282c6" (UID: "54fb8140-12ac-4465-bd3b-c415968282c6"). InnerVolumeSpecName "kube-api-access-fch9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:17.867539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.867367    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-xks-ca" pod "54fb8140-12ac-4465-bd3b-c415968282c6" (UID: "54fb8140-12ac-4465-bd3b-c415968282c6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:17.896252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.896231    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:17.947572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.946469    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dc867708-9929-4cbd-bb8a-fb14856f23c3-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc867708-9929-4cbd-bb8a-fb14856f23c3-maas-api-service-ca\") pod \"dc867708-9929-4cbd-bb8a-fb14856f23c3\" (UID: \"dc867708-9929-4cbd-bb8a-fb14856f23c3\") "
Oct 30 21:45:17.947572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.946654    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc867708-9929-4cbd-bb8a-fb14856f23c3-kube-api-access-4twk8\" (UniqueName: \"kubernetes.io/projected/dc867708-9929-4cbd-bb8a-fb14856f23c3-kube-api-access-4twk8\") pod \"dc867708-9929-4cbd-bb8a-fb14856f23c3\" (UID: \"dc867708-9929-4cbd-bb8a-fb14856f23c3\") "
Oct 30 21:45:17.947572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.947192    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:17.947572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.947213    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fch9h\" (UniqueName: \"kubernetes.io/projected/54fb8140-12ac-4465-bd3b-c415968282c6-kube-api-access-fch9h\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:17.947572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.947229    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54fb8140-12ac-4465-bd3b-c415968282c6-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:17.950227 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.950141    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc867708-9929-4cbd-bb8a-fb14856f23c3-maas-api-service-ca" pod "dc867708-9929-4cbd-bb8a-fb14856f23c3" (UID: "dc867708-9929-4cbd-bb8a-fb14856f23c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:17.951682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:17.951651    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc867708-9929-4cbd-bb8a-fb14856f23c3-kube-api-access-4twk8" pod "dc867708-9929-4cbd-bb8a-fb14856f23c3" (UID: "dc867708-9929-4cbd-bb8a-fb14856f23c3"). InnerVolumeSpecName "kube-api-access-4twk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:18.049031 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.048921    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc867708-9929-4cbd-bb8a-fb14856f23c3-maas-api-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:18.049031 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.048948    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4twk8\" (UniqueName: \"kubernetes.io/projected/dc867708-9929-4cbd-bb8a-fb14856f23c3-kube-api-access-4twk8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:18.080677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.080493    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:18.281475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.281438    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:45:18.281632 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.281507    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:45:18.457687 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.457659    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"
Oct 30 21:45:18.457888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.457700    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb" event={"ID":"dc867708-9929-4cbd-bb8a-fb14856f23c3","Type":"ContainerDied","Data":"92804f88fa67200c8a0543ce5f47781a380c6204cf2ae9581c8f4b044d6ee832"}
Oct 30 21:45:18.457888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.457768    5575 scope.go:122] "RemoveContainer" containerID="89e3aa976ff4482bd01c6826360bd8153bb7bd9c27b2f2266ed2eee7abd119ae"
Oct 30 21:45:18.460347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.460323    5575 generic.go:356] "Generic (PLEG): container finished" podID="25e1292b-5184-44dd-9af0-b12ff326536c" containerID="b6af310b2d2ab2cf2d016205d45e2a9dd0b8273e4a4a1c30602437d6ba2e044e" exitCode=60
Oct 30 21:45:18.460475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.460394    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" event={"ID":"25e1292b-5184-44dd-9af0-b12ff326536c","Type":"ContainerDied","Data":"b6af310b2d2ab2cf2d016205d45e2a9dd0b8273e4a4a1c30602437d6ba2e044e"}
Oct 30 21:45:18.460785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.460767    5575 scope.go:122] "RemoveContainer" containerID="b6af310b2d2ab2cf2d016205d45e2a9dd0b8273e4a4a1c30602437d6ba2e044e"
Oct 30 21:45:18.461074 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:18.461047    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5_odh-ai-gateway-infra(25e1292b-5184-44dd-9af0-b12ff326536c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" podUID="25e1292b-5184-44dd-9af0-b12ff326536c"
Oct 30 21:45:18.462234 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.462214    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5" event={"ID":"54fb8140-12ac-4465-bd3b-c415968282c6","Type":"ContainerDied","Data":"e4c809fad629862459f626af0cea0652eff7fc45ff622ee487c248a8350c3fb3"}
Oct 30 21:45:18.462343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.462273    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4c809fad629862459f626af0cea0652eff7fc45ff622ee487c248a8350c3fb3"
Oct 30 21:45:18.462343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.462223    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"
Oct 30 21:45:18.471933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.471917    5575 scope.go:122] "RemoveContainer" containerID="8fe488287274a47a2413195c0438c277ce77860c9109e19ebb537b3bbe61a44f"
Oct 30 21:45:18.629143 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.629095    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"]
Oct 30 21:45:18.633951 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:18.633914    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-1de75a-29889945-lnqqb"]
Oct 30 21:45:19.129779 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:19.129749    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" path="/var/lib/kubelet/pods/dc867708-9929-4cbd-bb8a-fb14856f23c3/volumes"
Oct 30 21:45:19.612716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:19.612683    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:19.613939 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:19.613903    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:19.615594 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:19.615571    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:45:19.808735 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:19.808643    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"]
Oct 30 21:45:20.039246 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.039214    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:20.079320 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.079242    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25e1292b-5184-44dd-9af0-b12ff326536c-kube-api-access-8rwrt\" (UniqueName: \"kubernetes.io/projected/25e1292b-5184-44dd-9af0-b12ff326536c-kube-api-access-8rwrt\") pod \"25e1292b-5184-44dd-9af0-b12ff326536c\" (UID: \"25e1292b-5184-44dd-9af0-b12ff326536c\") "
Oct 30 21:45:20.079320 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.079283    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25e1292b-5184-44dd-9af0-b12ff326536c-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e1292b-5184-44dd-9af0-b12ff326536c-maas-api-service-ca\") pod \"25e1292b-5184-44dd-9af0-b12ff326536c\" (UID: \"25e1292b-5184-44dd-9af0-b12ff326536c\") "
Oct 30 21:45:20.079670 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.079645    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25e1292b-5184-44dd-9af0-b12ff326536c-maas-api-service-ca" pod "25e1292b-5184-44dd-9af0-b12ff326536c" (UID: "25e1292b-5184-44dd-9af0-b12ff326536c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:20.081638 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.081615    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25e1292b-5184-44dd-9af0-b12ff326536c-kube-api-access-8rwrt" pod "25e1292b-5184-44dd-9af0-b12ff326536c" (UID: "25e1292b-5184-44dd-9af0-b12ff326536c"). InnerVolumeSpecName "kube-api-access-8rwrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:20.181055 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.181025    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rwrt\" (UniqueName: \"kubernetes.io/projected/25e1292b-5184-44dd-9af0-b12ff326536c-kube-api-access-8rwrt\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:20.181055 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.181056    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e1292b-5184-44dd-9af0-b12ff326536c-maas-api-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:20.482924 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.482896    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"
Oct 30 21:45:20.483140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.483014    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5" event={"ID":"25e1292b-5184-44dd-9af0-b12ff326536c","Type":"ContainerDied","Data":"e5394db99318a8b278cd14f267f0dec37360110a711236c067756e1195c821ee"}
Oct 30 21:45:20.483140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.483068    5575 scope.go:122] "RemoveContainer" containerID="b6af310b2d2ab2cf2d016205d45e2a9dd0b8273e4a4a1c30602437d6ba2e044e"
Oct 30 21:45:20.651372 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.651339    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"]
Oct 30 21:45:20.654866 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:20.654846    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-6ea374-29889945-t4jr5"]
Oct 30 21:45:21.128069 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:21.128035    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" path="/var/lib/kubelet/pods/25e1292b-5184-44dd-9af0-b12ff326536c/volumes"
Oct 30 21:45:22.191508 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.191476    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"]
Oct 30 21:45:22.192262 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192244    5575 cpu_manager.go:414] "containerMap: removing container" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerName="cleanup"
Oct 30 21:45:22.192338 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192264    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerName="cleanup"
Oct 30 21:45:22.192338 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192280    5575 cpu_manager.go:414] "containerMap: removing container" podUID="0e030c96-10cd-4593-8667-63f5f47e95f7" containerName="revoke-keys"
Oct 30 21:45:22.192338 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192285    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e030c96-10cd-4593-8667-63f5f47e95f7" containerName="revoke-keys"
Oct 30 21:45:22.192338 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192308    5575 cpu_manager.go:414] "containerMap: removing container" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" containerName="cleanup"
Oct 30 21:45:22.192338 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192314    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192345    5575 cpu_manager.go:414] "containerMap: removing container" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192351    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192360    5575 cpu_manager.go:414] "containerMap: removing container" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192365    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192376    5575 cpu_manager.go:414] "containerMap: removing container" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192383    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192411    5575 cpu_manager.go:414] "containerMap: removing container" podUID="54fb8140-12ac-4465-bd3b-c415968282c6" containerName="revoke-keys"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192416    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54fb8140-12ac-4465-bd3b-c415968282c6" containerName="revoke-keys"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192424    5575 cpu_manager.go:414] "containerMap: removing container" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192428    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192518    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e030c96-10cd-4593-8667-63f5f47e95f7" containerName="revoke-keys"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192529    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" containerName="cleanup"
Oct 30 21:45:22.192532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192535    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" containerName="cleanup"
Oct 30 21:45:22.192908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192541    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerName="cleanup"
Oct 30 21:45:22.192908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192547    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerName="cleanup"
Oct 30 21:45:22.192908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.192554    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="54fb8140-12ac-4465-bd3b-c415968282c6" containerName="revoke-keys"
Oct 30 21:45:22.197271 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.197252    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.304629 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.304593    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.304798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.304638    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-certs\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.304798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.304721    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-data\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.304882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.304828    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a1151f8-169a-43ed-8c22-c0106b68049d-istiod-ca-cert\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.304917 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.304880    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-envoy\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.305018 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.304993    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5dkl\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-kube-api-access-v5dkl\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.305169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.305152    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-podinfo\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.305211 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.305191    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-token\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.305250 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.305236    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-credential-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.306161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.306143    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"]
Oct 30 21:45:22.406000 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.405954    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5dkl\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-kube-api-access-v5dkl\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406082    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-podinfo\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406113    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-token\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406133    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-credential-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406414 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406215    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406414 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406244    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-certs\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406414 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406268    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-data\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406414 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406345    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a1151f8-169a-43ed-8c22-c0106b68049d-istiod-ca-cert\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406414 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406409    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-envoy\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406690 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406657    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406752 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406702    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-credential-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406810 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406746    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-certs\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.406936 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.406910    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-data\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.407390 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.407362    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a1151f8-169a-43ed-8c22-c0106b68049d-istiod-ca-cert\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.409055 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.409037    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-envoy\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.409243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.409226    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-podinfo\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.468411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.468336    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-token\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.468600 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.468571    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5dkl\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-kube-api-access-v5dkl\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.510789 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.510764    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:22.947561 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:22.947530    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1151f8_169a_43ed_8c22_c0106b68049d.slice/crio-3947de964d5a0980d89dd0158ba0f3ef59c8ebd9f8353bf66d69b7e074ae6b3f WatchSource:0}: Error finding container 3947de964d5a0980d89dd0158ba0f3ef59c8ebd9f8353bf66d69b7e074ae6b3f: Status 404 returned error can't find the container with id 3947de964d5a0980d89dd0158ba0f3ef59c8ebd9f8353bf66d69b7e074ae6b3f
Oct 30 21:45:22.947774 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.947754    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"]
Oct 30 21:45:22.950272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.950238    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:22.950339 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.950321    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:22.950375 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:22.950362    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:23.117820 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.117785    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:23.491785 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:23.489755    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:45:23.523426 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.523383    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" event={"ID":"3a1151f8-169a-43ed-8c22-c0106b68049d","Type":"ContainerStarted","Data":"f4b9351f25a509a3c8d643dfd7e4df5bf75640ebcf4aa430f6babe8bbaf86162"}
Oct 30 21:45:23.523612 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.523488    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" event={"ID":"3a1151f8-169a-43ed-8c22-c0106b68049d","Type":"ContainerStarted","Data":"3947de964d5a0980d89dd0158ba0f3ef59c8ebd9f8353bf66d69b7e074ae6b3f"}
Oct 30 21:45:23.647404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.647372    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"]
Oct 30 21:45:23.648151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.648135    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="25e1292b-5184-44dd-9af0-b12ff326536c" containerName="cleanup"
Oct 30 21:45:23.648203 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.648153    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc867708-9929-4cbd-bb8a-fb14856f23c3" containerName="cleanup"
Oct 30 21:45:23.649348 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.649284    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" podStartSLOduration=1.6492672430000002 podStartE2EDuration="1.649267243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:23.64435434 +0000 UTC m=+1324.676202876" watchObservedRunningTime="2026-10-30 21:45:23.649267243 +0000 UTC m=+1324.681115778"
Oct 30 21:45:23.651813 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.651793    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.680649 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.680101    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"]
Oct 30 21:45:23.744240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.744149    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-certs\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.744240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.744186    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-token\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.744240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.744214    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2e13ac-08d3-4dde-9264-a40bad982399-istiod-ca-cert\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.744469 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.744415    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-podinfo\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.744469 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.744455    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-data\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.744573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.744525    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-envoy\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.744628 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.744592    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.744688 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.744635    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-credential-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.744811 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.744786    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n8hx\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-kube-api-access-6n8hx\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.846256 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.846218    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-podinfo\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.846449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.846287    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-data\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.846449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.846335    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-envoy\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.846449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.846378    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.846449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.846416    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-credential-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.846661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.846480    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n8hx\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-kube-api-access-6n8hx\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.846661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.846531    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-certs\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.846661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.846554    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-token\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.846661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.846579    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2e13ac-08d3-4dde-9264-a40bad982399-istiod-ca-cert\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.847082 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.847057    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-certs\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.847147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.847097    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-credential-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.847346 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.847324    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-data\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.847428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.847407    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2e13ac-08d3-4dde-9264-a40bad982399-istiod-ca-cert\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.848350 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.848325    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-socket\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.849819 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.849800    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-envoy\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.850182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.850161    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-podinfo\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.916988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.915896    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-token\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.940314 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.939866    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n8hx\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-kube-api-access-6n8hx\") pod \"e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") " pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:23.975736 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:23.975709    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:24.448148 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:24.448115    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"]
Oct 30 21:45:24.448408 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:24.448383    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2e13ac_08d3_4dde_9264_a40bad982399.slice/crio-8fce64f8b766b2edb8477b3a53ea4cc9a16c8921ef3084f7db72787e1acaeaa1 WatchSource:0}: Error finding container 8fce64f8b766b2edb8477b3a53ea4cc9a16c8921ef3084f7db72787e1acaeaa1: Status 404 returned error can't find the container with id 8fce64f8b766b2edb8477b3a53ea4cc9a16c8921ef3084f7db72787e1acaeaa1
Oct 30 21:45:24.451366 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:24.451335    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:24.451438 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:24.451404    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:24.451438 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:24.451433    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:24.514192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:24.514117    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:24.522855 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:24.522533    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:45:24.522855 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:24.522585    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:45:24.538518 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:24.538491    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" event={"ID":"7c2e13ac-08d3-4dde-9264-a40bad982399","Type":"ContainerStarted","Data":"8fce64f8b766b2edb8477b3a53ea4cc9a16c8921ef3084f7db72787e1acaeaa1"}
Oct 30 21:45:25.534989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:25.534102    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:45:25.534989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:25.534171    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:45:25.565634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:25.565598    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" event={"ID":"7c2e13ac-08d3-4dde-9264-a40bad982399","Type":"ContainerStarted","Data":"bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a"}
Oct 30 21:45:25.689345 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:25.689293    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podStartSLOduration=2.689279462 podStartE2EDuration="2.689279462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:25.688505287 +0000 UTC m=+1326.720353823" watchObservedRunningTime="2026-10-30 21:45:25.689279462 +0000 UTC m=+1326.721127996"
Oct 30 21:45:25.976862 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:25.976814    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:25.978244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:25.978217    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:45:25.978396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:25.978263    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:45:26.519992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:26.516274    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:45:26.519992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:26.516333    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:45:26.976101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:26.976068    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:45:26.976541 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:26.976516    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:45:27.527990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:27.527378    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:45:27.527990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:27.527465    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:45:27.976467 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:27.976425    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:45:27.976984 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:27.976488    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:45:28.200148 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:28.200109    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:28.522559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:28.522523    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:45:28.522827 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:28.522798    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:45:28.976828 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:28.976797    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:45:28.977227 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:28.976848    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:45:29.519088 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:29.519051    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:45:29.519371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:29.519341    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:45:29.976106 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:29.976073    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:45:29.976305 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:29.976168    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:45:30.645122 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:30.645091    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:30.646102 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:30.646084    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:30.647464 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:30.647442    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:45:31.025102 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:31.025026    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:45:31.025295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:31.025266    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:45:32.049850 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.049814    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"]
Oct 30 21:45:32.055819 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.055797    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.165382 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.165348    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"]
Oct 30 21:45:32.177702 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.177666    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.177877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.177752    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.177978 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.177876    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d142727-6bbc-44ab-a876-332206529309-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.178227 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.178200    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.178401 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.178376    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgw7b\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-kube-api-access-tgw7b\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.178627 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.178601    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.178728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.178707    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.178796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.178751    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.178856 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.178793    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d142727-6bbc-44ab-a876-332206529309-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.222078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.222045    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:32.223805 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.223697    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:32.225147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.225128    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 21:45:32.279809 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.279764    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280007 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.279845    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280134 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280105    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d142727-6bbc-44ab-a876-332206529309-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280223    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280378 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280258    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw7b\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-kube-api-access-tgw7b\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280378 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280291    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-data\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280378 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280363    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-certs\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280389    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280475    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280593 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280519    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280649 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280589    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d142727-6bbc-44ab-a876-332206529309-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.280871 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.280834    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-credential-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.281021 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.281000    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-socket\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.281386 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.281361    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d142727-6bbc-44ab-a876-332206529309-istiod-ca-cert\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.283344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.283322    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-envoy\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.283924 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.283904    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d142727-6bbc-44ab-a876-332206529309-istio-podinfo\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.346182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.346124    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-istio-token\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.346408 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.346379    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgw7b\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-kube-api-access-tgw7b\") pod \"e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") " pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.371575 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.371548    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:32.880087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.880056    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"]
Oct 30 21:45:32.885470 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:32.885441    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d142727_6bbc_44ab_a876_332206529309.slice/crio-0591960f926ccd05ac1e8e778e8bd21db75e71c9ac96be71aa007e2c8c581226 WatchSource:0}: Error finding container 0591960f926ccd05ac1e8e778e8bd21db75e71c9ac96be71aa007e2c8c581226: Status 404 returned error can't find the container with id 0591960f926ccd05ac1e8e778e8bd21db75e71c9ac96be71aa007e2c8c581226
Oct 30 21:45:32.888584 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.888544    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:32.888669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.888639    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:32.888708 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:32.888694    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:33.226499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:33.226465    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:33.652790 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:33.652756    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" event={"ID":"9d142727-6bbc-44ab-a876-332206529309","Type":"ContainerStarted","Data":"857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55"}
Oct 30 21:45:33.652995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:33.652814    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" event={"ID":"9d142727-6bbc-44ab-a876-332206529309","Type":"ContainerStarted","Data":"0591960f926ccd05ac1e8e778e8bd21db75e71c9ac96be71aa007e2c8c581226"}
Oct 30 21:45:34.372548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.372513    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:34.374606 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.374576    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:45:34.374755 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.374635    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:45:34.722990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.722392    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" podStartSLOduration=2.722371378 podStartE2EDuration="2.722371378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:33.845339038 +0000 UTC m=+1334.877187584" watchObservedRunningTime="2026-10-30 21:45:34.722371378 +0000 UTC m=+1335.754219908"
Oct 30 21:45:34.737351 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.737320    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7082-e10c09"]
Oct 30 21:45:34.742228 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.742209    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:34.760867 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.760839    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mq29\" (UniqueName: \"kubernetes.io/projected/ca01c492-0586-41f7-8d18-69395ae6f780-kube-api-access-6mq29\") pod \"test-curl-7082-e10c09\" (UID: \"ca01c492-0586-41f7-8d18-69395ae6f780\") " pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:34.778032 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.778014    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7082-e10c09"]
Oct 30 21:45:34.795171 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.795150    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncw9l\""
Oct 30 21:45:34.862603 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.862575    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mq29\" (UniqueName: \"kubernetes.io/projected/ca01c492-0586-41f7-8d18-69395ae6f780-kube-api-access-6mq29\") pod \"test-curl-7082-e10c09\" (UID: \"ca01c492-0586-41f7-8d18-69395ae6f780\") " pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:34.938321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:34.938284    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mq29\" (UniqueName: \"kubernetes.io/projected/ca01c492-0586-41f7-8d18-69395ae6f780-kube-api-access-6mq29\") pod \"test-curl-7082-e10c09\" (UID: \"ca01c492-0586-41f7-8d18-69395ae6f780\") " pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:35.055699 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:35.055611    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:35.372429 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:35.372347    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:45:35.372604 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:35.372420    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:45:35.472588 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:35.472560    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7082-e10c09"]
Oct 30 21:45:35.475301 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:35.475275    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca01c492_0586_41f7_8d18_69395ae6f780.slice/crio-a77275b124002fe8d65307bf8357409cbe2c64ffab509bdbb37c990f907e0e7c WatchSource:0}: Error finding container a77275b124002fe8d65307bf8357409cbe2c64ffab509bdbb37c990f907e0e7c: Status 404 returned error can't find the container with id a77275b124002fe8d65307bf8357409cbe2c64ffab509bdbb37c990f907e0e7c
Oct 30 21:45:35.478049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:35.478030    5575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:45:35.672864 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:35.672832    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7082-e10c09" event={"ID":"ca01c492-0586-41f7-8d18-69395ae6f780","Type":"ContainerStarted","Data":"a77275b124002fe8d65307bf8357409cbe2c64ffab509bdbb37c990f907e0e7c"}
Oct 30 21:45:36.372700 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:36.372663    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:45:36.373104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:36.372719    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:45:37.372342 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:37.372293    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:45:37.372523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:37.372360    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:45:37.689448 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:37.689408    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7082-e10c09" event={"ID":"ca01c492-0586-41f7-8d18-69395ae6f780","Type":"ContainerStarted","Data":"98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465"}
Oct 30 21:45:37.825991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:37.824308    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7082-e10c09" podStartSLOduration=2.6652247 podStartE2EDuration="3.824289183s" totalImagesPullingTime="1.159064483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:37.806395944 +0000 UTC m=+1338.838244479" watchObservedRunningTime="2026-10-30 21:45:37.824289183 +0000 UTC m=+1338.856137719"
Oct 30 21:45:38.182117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:38.182084    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:38.372539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:38.372502    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:45:38.372742 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:38.372559    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:45:39.362182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.362153    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7082-e10c09"]
Oct 30 21:45:39.367863 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.367836    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7082-e10c09"]
Oct 30 21:45:39.373118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.373089    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:45:39.373266 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.373166    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:45:39.542264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.542220    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7082-7fe0fa"]
Oct 30 21:45:39.543209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.543183    5575 cpu_manager.go:414] "containerMap: removing container" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" containerName="test-curl-7082-e10c09"
Oct 30 21:45:39.543209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.543207    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" containerName="test-curl-7082-e10c09"
Oct 30 21:45:39.543421 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.543408    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" containerName="test-curl-7082-e10c09"
Oct 30 21:45:39.547610 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.547587    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7082-7fe0fa"
Oct 30 21:45:39.606357 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.606326    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7082-7fe0fa"]
Oct 30 21:45:39.680415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.680382    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kg9z\" (UniqueName: \"kubernetes.io/projected/0fa9007d-00d3-48b9-af8a-c020f635dc99-kube-api-access-9kg9z\") pod \"test-curl-7082-7fe0fa\" (UID: \"0fa9007d-00d3-48b9-af8a-c020f635dc99\") " pod="opendatahub/test-curl-7082-7fe0fa"
Oct 30 21:45:39.717010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.709175    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7082-e10c09" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" containerName="test-curl-7082-e10c09" containerID="cri-o://98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465" gracePeriod=2
Oct 30 21:45:39.761789 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:39.761750    5575 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7082-e10c09\" is forbidden: User \"system:node:ip-10-0-136-135.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-135.us-west-1.compute.internal' and this object" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:39.781430 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.781406    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kg9z\" (UniqueName: \"kubernetes.io/projected/0fa9007d-00d3-48b9-af8a-c020f635dc99-kube-api-access-9kg9z\") pod \"test-curl-7082-7fe0fa\" (UID: \"0fa9007d-00d3-48b9-af8a-c020f635dc99\") " pod="opendatahub/test-curl-7082-7fe0fa"
Oct 30 21:45:39.842925 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.842888    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kg9z\" (UniqueName: \"kubernetes.io/projected/0fa9007d-00d3-48b9-af8a-c020f635dc99-kube-api-access-9kg9z\") pod \"test-curl-7082-7fe0fa\" (UID: \"0fa9007d-00d3-48b9-af8a-c020f635dc99\") " pod="opendatahub/test-curl-7082-7fe0fa"
Oct 30 21:45:39.874091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:39.874058    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7082-7fe0fa"
Oct 30 21:45:40.022264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:40.022043    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:40.178322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:40.178288    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:40.305100 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:40.305073    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7082-7fe0fa"]
Oct 30 21:45:40.306249 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:40.306215    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fa9007d_00d3_48b9_af8a_c020f635dc99.slice/crio-39bbf068e4816a1259532962b8d1defc1db8563fa8c96a2396a1fa8cb61a1e27 WatchSource:0}: Error finding container 39bbf068e4816a1259532962b8d1defc1db8563fa8c96a2396a1fa8cb61a1e27: Status 404 returned error can't find the container with id 39bbf068e4816a1259532962b8d1defc1db8563fa8c96a2396a1fa8cb61a1e27
Oct 30 21:45:40.465923 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:40.465892    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:40.466450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:40.466430    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:40.467556 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:40.467518    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:45:40.517448 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:40.517411    5575 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7082-e10c09\" is forbidden: User \"system:node:ip-10-0-136-135.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-135.us-west-1.compute.internal' and this object" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:40.720623 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:40.720577    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7082-7fe0fa" event={"ID":"0fa9007d-00d3-48b9-af8a-c020f635dc99","Type":"ContainerStarted","Data":"710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f"}
Oct 30 21:45:40.720623 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:40.720622    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7082-7fe0fa" event={"ID":"0fa9007d-00d3-48b9-af8a-c020f635dc99","Type":"ContainerStarted","Data":"39bbf068e4816a1259532962b8d1defc1db8563fa8c96a2396a1fa8cb61a1e27"}
Oct 30 21:45:40.754864 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:40.754830    5575 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7082-e10c09\" is forbidden: User \"system:node:ip-10-0-136-135.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-135.us-west-1.compute.internal' and this object" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:40.856224 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:40.856193    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:41.010243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:41.007855    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7082-7fe0fa" podStartSLOduration=2.007841062 podStartE2EDuration="2.007841062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:40.997600775 +0000 UTC m=+1342.029449310" watchObservedRunningTime="2026-10-30 21:45:41.007841062 +0000 UTC m=+1342.039689597"
Oct 30 21:45:41.048885 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:41.048843    5575 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7082-e10c09\" is forbidden: User \"system:node:ip-10-0-136-135.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-135.us-west-1.compute.internal' and this object" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:41.978769 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:41.978708    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:42.123730 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.123689    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca01c492-0586-41f7-8d18-69395ae6f780-kube-api-access-6mq29\" (UniqueName: \"kubernetes.io/projected/ca01c492-0586-41f7-8d18-69395ae6f780-kube-api-access-6mq29\") pod \"ca01c492-0586-41f7-8d18-69395ae6f780\" (UID: \"ca01c492-0586-41f7-8d18-69395ae6f780\") "
Oct 30 21:45:42.126259 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.126227    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca01c492-0586-41f7-8d18-69395ae6f780-kube-api-access-6mq29" pod "ca01c492-0586-41f7-8d18-69395ae6f780" (UID: "ca01c492-0586-41f7-8d18-69395ae6f780"). InnerVolumeSpecName "kube-api-access-6mq29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:42.225905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.225869    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mq29\" (UniqueName: \"kubernetes.io/projected/ca01c492-0586-41f7-8d18-69395ae6f780-kube-api-access-6mq29\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:42.563219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.563127    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7082-7fe0fa"]
Oct 30 21:45:42.605259 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.605226    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7082-7fe0fa"]
Oct 30 21:45:42.742601 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.742566    5575 generic.go:356] "Generic (PLEG): container finished" podID="ca01c492-0586-41f7-8d18-69395ae6f780" containerID="98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465" exitCode=137
Oct 30 21:45:42.742781 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.742630    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:42.742781 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.742679    5575 scope.go:122] "RemoveContainer" containerID="98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465"
Oct 30 21:45:42.742908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.742835    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7082-7fe0fa" podUID="0fa9007d-00d3-48b9-af8a-c020f635dc99" containerName="test-curl-7082-7fe0fa" containerID="cri-o://710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f" gracePeriod=2
Oct 30 21:45:42.754884 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.754856    5575 scope.go:122] "RemoveContainer" containerID="98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465"
Oct 30 21:45:42.755295 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:42.755271    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465\": container with ID starting with 98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465 not found: ID does not exist" containerID="98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465"
Oct 30 21:45:42.755397 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:42.755301    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465"} err="failed to get container status \"98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465\": rpc error: code = NotFound desc = could not find container \"98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465\": container with ID starting with 98d5c22a448fb38bb69cb7f9d0cb843984f2e691ea6050c053a0d42131c99465 not found: ID does not exist"
Oct 30 21:45:42.794311 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:42.794274    5575 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7082-7fe0fa\" is forbidden: User \"system:node:ip-10-0-136-135.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-135.us-west-1.compute.internal' and this object" podUID="0fa9007d-00d3-48b9-af8a-c020f635dc99" pod="opendatahub/test-curl-7082-7fe0fa"
Oct 30 21:45:42.845698 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:42.845609    5575 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7082-7fe0fa\" is forbidden: User \"system:node:ip-10-0-136-135.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-135.us-west-1.compute.internal' and this object" podUID="0fa9007d-00d3-48b9-af8a-c020f635dc99" pod="opendatahub/test-curl-7082-7fe0fa"
Oct 30 21:45:42.897256 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:42.897219    5575 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7082-e10c09\" is forbidden: User \"system:node:ip-10-0-136-135.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-135.us-west-1.compute.internal' and this object" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" pod="opendatahub/test-curl-7082-e10c09"
Oct 30 21:45:43.152180 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:43.145129    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca01c492-0586-41f7-8d18-69395ae6f780" path="/var/lib/kubelet/pods/ca01c492-0586-41f7-8d18-69395ae6f780/volumes"
Oct 30 21:45:43.199495 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:43.199466    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:43.471797 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:43.471708    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:44.034833 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.034791    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"]
Oct 30 21:45:44.035547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.035527    5575 cpu_manager.go:414] "containerMap: removing container" podUID="0fa9007d-00d3-48b9-af8a-c020f635dc99" containerName="test-curl-7082-7fe0fa"
Oct 30 21:45:44.035646 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.035549    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0fa9007d-00d3-48b9-af8a-c020f635dc99" containerName="test-curl-7082-7fe0fa"
Oct 30 21:45:44.035720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.035708    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="0fa9007d-00d3-48b9-af8a-c020f635dc99" containerName="test-curl-7082-7fe0fa"
Oct 30 21:45:44.041005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.040945    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.058729 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.058701    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a40198-99a8-468c-bd13-0d42a577d80c-istio-podinfo\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.058848 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.058769    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-envoy\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.058909 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.058848    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-certs\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.058976 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.058904    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7cg6\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-kube-api-access-k7cg6\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.058976 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.058929    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-socket\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.058976 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.058954    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-istio-token\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.059098 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.059077    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-credential-socket\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.059153 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.059139    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a40198-99a8-468c-bd13-0d42a577d80c-istiod-ca-cert\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.059282 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.059259    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-data\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.118936 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.111503    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1d456a94-openshift-default-dockercfg-7fwk8\""
Oct 30 21:45:44.118936 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.118536    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"]
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.160432    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a40198-99a8-468c-bd13-0d42a577d80c-istiod-ca-cert\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.160551    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-data\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.160629    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a40198-99a8-468c-bd13-0d42a577d80c-istio-podinfo\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.160701    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-envoy\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.160736    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-certs\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.160782    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7cg6\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-kube-api-access-k7cg6\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.160810    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-socket\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.160845    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-istio-token\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.160953    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-credential-socket\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.162052    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a40198-99a8-468c-bd13-0d42a577d80c-istiod-ca-cert\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.162837    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-data\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.164990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.163399    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-certs\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.166020 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.165162    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:44.166020 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.165308    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-socket\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.166195 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.166144    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-credential-socket\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.189147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.184198    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-envoy\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.189147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.184677    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a40198-99a8-468c-bd13-0d42a577d80c-istio-podinfo\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.230002 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.226943    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7cg6\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-kube-api-access-k7cg6\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.240998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.239508    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-istio-token\") pod \"e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") " pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.356518 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.355159    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:44.784326 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.784282    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:44.823066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.823034    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"]
Oct 30 21:45:44.829646 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:44.829614    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a40198_99a8_468c_bd13_0d42a577d80c.slice/crio-152cd641c00ac5aef06a06a5d45e313e274f2f3e4a09f21e8c6faae69cdb9bf1 WatchSource:0}: Error finding container 152cd641c00ac5aef06a06a5d45e313e274f2f3e4a09f21e8c6faae69cdb9bf1: Status 404 returned error can't find the container with id 152cd641c00ac5aef06a06a5d45e313e274f2f3e4a09f21e8c6faae69cdb9bf1
Oct 30 21:45:44.833043 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.833005    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:44.833195 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.833121    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:44.833286 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:44.833190    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:45.020456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.020429    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7082-7fe0fa"
Oct 30 21:45:45.083921 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.083879    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0fa9007d-00d3-48b9-af8a-c020f635dc99-kube-api-access-9kg9z\" (UniqueName: \"kubernetes.io/projected/0fa9007d-00d3-48b9-af8a-c020f635dc99-kube-api-access-9kg9z\") pod \"0fa9007d-00d3-48b9-af8a-c020f635dc99\" (UID: \"0fa9007d-00d3-48b9-af8a-c020f635dc99\") "
Oct 30 21:45:45.090103 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.090073    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa9007d-00d3-48b9-af8a-c020f635dc99-kube-api-access-9kg9z" pod "0fa9007d-00d3-48b9-af8a-c020f635dc99" (UID: "0fa9007d-00d3-48b9-af8a-c020f635dc99"). InnerVolumeSpecName "kube-api-access-9kg9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:45.129169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.129134    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0fa9007d-00d3-48b9-af8a-c020f635dc99" path="/var/lib/kubelet/pods/0fa9007d-00d3-48b9-af8a-c020f635dc99/volumes"
Oct 30 21:45:45.186210 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.186181    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kg9z\" (UniqueName: \"kubernetes.io/projected/0fa9007d-00d3-48b9-af8a-c020f635dc99-kube-api-access-9kg9z\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:45.857626 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.857582    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" event={"ID":"71a40198-99a8-468c-bd13-0d42a577d80c","Type":"ContainerStarted","Data":"60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3"}
Oct 30 21:45:45.857812 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.857657    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" event={"ID":"71a40198-99a8-468c-bd13-0d42a577d80c","Type":"ContainerStarted","Data":"152cd641c00ac5aef06a06a5d45e313e274f2f3e4a09f21e8c6faae69cdb9bf1"}
Oct 30 21:45:45.860833 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.860805    5575 generic.go:356] "Generic (PLEG): container finished" podID="0fa9007d-00d3-48b9-af8a-c020f635dc99" containerID="710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f" exitCode=137
Oct 30 21:45:45.861194 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.861175    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7082-7fe0fa"
Oct 30 21:45:45.865623 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.865496    5575 scope.go:122] "RemoveContainer" containerID="710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f"
Oct 30 21:45:45.910007 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.909955    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:45.914613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.914581    5575 scope.go:122] "RemoveContainer" containerID="710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f"
Oct 30 21:45:45.915152 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:45.915122    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f\": container with ID starting with 710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f not found: ID does not exist" containerID="710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f"
Oct 30 21:45:45.915335 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.915303    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f"} err="failed to get container status \"710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f\": rpc error: code = NotFound desc = could not find container \"710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f\": container with ID starting with 710d5a25e706553ca2ede3bb99d7f4d218e161ed9bd192015264897e4942f66f not found: ID does not exist"
Oct 30 21:45:45.985253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:45.985190    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" podStartSLOduration=2.985171102 podStartE2EDuration="2.985171102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:45.983121951 +0000 UTC m=+1347.014970487" watchObservedRunningTime="2026-10-30 21:45:45.985171102 +0000 UTC m=+1347.017019638"
Oct 30 21:45:46.084112 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:46.084078    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:46.357809 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:46.356500    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:46.420991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:46.420433    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:46.705996 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:46.704786    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:46.951137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:46.951054    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:46.968049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:46.964380    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:45:47.368050 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.367860    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:47.524127 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.503687    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:47.638989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.638571    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:47.820005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.812191    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:47.820005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.812544    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:45:47.820005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.813981    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:47.832989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.820827    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:45:47.860987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.833689    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 21:45:47.860987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.835926    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:47.860987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:47.845333    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:48.028602 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.028507    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:48.293162 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.293066    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:45:48.301924 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.301880    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:48.320665 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.320609    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:48.376202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.376161    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:48.377662 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.377634    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:45:48.518101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.518056    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 21:45:48.518876 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.518851    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:45:48.528681 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.528642    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:48.703621 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.702698    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:48.707360 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.707338    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"]
Oct 30 21:45:48.720278 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.720250    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:48.820991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.784353    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e6f16377-openshift-default-dockercfg-7klh6\""
Oct 30 21:45:48.829415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.829369    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:48.829740 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.829714    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:48.915560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.886146    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:48.915560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.830270    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:45:48.915560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.887462    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:45:48.915560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.887507    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:45:48.998385 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.998286    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 21:45:48.999684 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.999653    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-socket\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:48.999929 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:48.999907    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z52n4\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-kube-api-access-z52n4\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.000110 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.000093    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-certs\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.000279 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.000260    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-data\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.000413 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.000397    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73e3621a-248e-460a-bd16-523c4302058b-istio-podinfo\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.000536 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.000517    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-istio-token\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.000731 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.000713    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-credential-socket\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.000940 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.000921    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73e3621a-248e-460a-bd16-523c4302058b-istiod-ca-cert\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.001112 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.001095    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-envoy\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.004452 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.002328    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:45:49.008910 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.008868    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:45:49.009325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.009305    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:45:49.139991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.112950    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73e3621a-248e-460a-bd16-523c4302058b-istio-podinfo\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.141602 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.141568    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-istio-token\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.142020 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.141996    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-credential-socket\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.156987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.142276    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73e3621a-248e-460a-bd16-523c4302058b-istiod-ca-cert\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.159337 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.159308    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-envoy\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.245499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.165901    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:49.250405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.166560    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-credential-socket\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.274675 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.167137    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"]
Oct 30 21:45:49.275057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.172906    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73e3621a-248e-460a-bd16-523c4302058b-istiod-ca-cert\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.275254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.245796    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-socket\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.275465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.246178    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-socket\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.276444 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.276088    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z52n4\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-kube-api-access-z52n4\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.322229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.289337    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-certs\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.322229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.289487    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-data\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.322229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.289800    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-certs\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.322229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.289904    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-data\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.540043 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.502803    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:49.540043 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.523575    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 21:45:49.620320 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.620290    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:49.682226 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.636694    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z52n4\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-kube-api-access-z52n4\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.727076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.727039    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73e3621a-248e-460a-bd16-523c4302058b-istio-podinfo\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.769018 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.761640    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-envoy\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:49.891063 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.861084    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:49.900037 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.890646    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:49.950621 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:49.890685    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:45:50.066830 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.024357    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:45:50.066830 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.024412    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 21:45:50.066830 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.050641    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:50.098005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.086189    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-istio-token\") pod \"e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") " pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:50.327050 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.305613    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:50.428993 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:50.375168    5575 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.052s"
Oct 30 21:45:50.655066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.568182    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 21:45:50.753017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.734557    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:50.969076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.955226    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:50.969076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.958567    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:50.969076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:50.962402    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:45:51.401992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:51.325344    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:45:51.401992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:51.385172    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:45:51.412269 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:51.412225    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:45:51.412574 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:51.412545    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 21:45:51.568994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:51.565695    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:51.755579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:51.702579    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:52.044793 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.044665    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:52.046309 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.046260    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 21:45:52.046767 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.046726    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:45:52.167025 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:52.165320    5575 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.041s"
Oct 30 21:45:52.301046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.299890    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:45:52.329121 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.329077    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:52.346998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.331191    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:45:52.381443 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.381414    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:45:52.392993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.391958    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:45:52.421986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.417230    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:45:52.421986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.419542    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:45:52.421986 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.419752    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:45:52.491389 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.491355    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:45:52.491648 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.491630    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:45:52.495890 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.495321    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:45:52.756560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.756529    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"]
Oct 30 21:45:52.760497 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:45:52.760469    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e3621a_248e_460a_bd16_523c4302058b.slice/crio-384e3bb0b35b0d12be1e93605fc34ebb1de0a55094bbf70a51608156ea6dfb17 WatchSource:0}: Error finding container 384e3bb0b35b0d12be1e93605fc34ebb1de0a55094bbf70a51608156ea6dfb17: Status 404 returned error can't find the container with id 384e3bb0b35b0d12be1e93605fc34ebb1de0a55094bbf70a51608156ea6dfb17
Oct 30 21:45:52.763550 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.763521    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:52.763672 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.763598    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:52.763672 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:52.763646    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:53.001950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:53.001907    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:53.065754 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:53.065647    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" event={"ID":"73e3621a-248e-460a-bd16-523c4302058b","Type":"ContainerStarted","Data":"3b284a6be81eb2a258ee277cf0810ebcb9a4fd240674c8da4efeaad016937549"}
Oct 30 21:45:53.065754 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:53.065728    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" event={"ID":"73e3621a-248e-460a-bd16-523c4302058b","Type":"ContainerStarted","Data":"384e3bb0b35b0d12be1e93605fc34ebb1de0a55094bbf70a51608156ea6dfb17"}
Oct 30 21:45:53.357937 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:53.357870    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:53.373325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:53.373293    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:53.374321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:53.374295    5575 patch_prober.go:29] interesting pod/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:45:53.374565 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:53.374533    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:45:53.464341 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:53.464291    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" podStartSLOduration=5.464277606 podStartE2EDuration="5.464277606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:53.462847327 +0000 UTC m=+1354.494695862" watchObservedRunningTime="2026-10-30 21:45:53.464277606 +0000 UTC m=+1354.496126141"
Oct 30 21:45:53.497890 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:45:53.497852    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:45:53.525875 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:53.525829    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:54.377313 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:54.377283    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:55.097253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:55.097224    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:55.098222 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:55.098205    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:45:55.442030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:55.441992    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:55.626813 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:55.626770    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:55.813581 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:55.813487    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:56.026934 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:56.026900    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:56.200759 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:56.200726    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:56.566338 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:56.566254    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:56.768059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:56.768029    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:56.935085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:56.935050    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:57.118473 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:57.118428    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:58.501789 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:58.501753    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:59.119682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:59.119580    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:59.324324 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:45:59.324287    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:03.680317 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:03.680267    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:04.346354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:04.346319    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:04.513317 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:04.513291    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:04.883338 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:04.883299    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:06.605196 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:06.605154    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:06.784393 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:06.784339    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:06.936776 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:06.936730    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:07.432194 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.432159    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"]
Oct 30 21:46:07.436302 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.436281    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.479235 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.479206    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"]
Oct 30 21:46:07.488390 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.488365    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"]
Oct 30 21:46:07.488529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.488475    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.492847 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.492830    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.502170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.502150    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"]
Oct 30 21:46:07.511156 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.511129    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.529269 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.529239    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"]
Oct 30 21:46:07.556575 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.556548    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"]
Oct 30 21:46:07.567600 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.567571    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-envoy\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.567724 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.567606    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.567724 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.567645    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-credential-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.567846 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.567789    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.567892 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.567870    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.567999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.567945    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-envoy\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.568049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568033    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.568085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568072    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.568139 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568098    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64dv6\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-kube-api-access-64dv6\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.568139 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568128    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-credential-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.568205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568182    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-certs\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.568265 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568247    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-token\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.568319 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568301    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.568356 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568337    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.568403 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568377    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-token\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.568446 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568417    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.568487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568451    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.568535 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568520    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-data\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.568570 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568558    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.568635 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568615    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-certs\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.568693 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568679    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2pzv\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-kube-api-access-g2pzv\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.568742 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568702    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istiod-ca-cert\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.568742 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568727    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-data\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.568836 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568761    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istiod-ca-cert\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.568891 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568849    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-podinfo\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.568945 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568885    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.568945 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.568915    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da51dfef-219c-4058-a1ed-b69e8b08800a-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.569105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.569033    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.569105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.569074    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.569178 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.569128    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.569178 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.569166    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.569257 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.569220    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.569294 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.569264    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdwpq\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-kube-api-access-gdwpq\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.569339 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.569301    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.569339 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.569327    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-podinfo\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.569407 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.569387    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkc8j\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-kube-api-access-zkc8j\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.593089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.593065    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"]
Oct 30 21:46:07.605905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.605877    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"]
Oct 30 21:46:07.671195 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671160    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.671395 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671206    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64dv6\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-kube-api-access-64dv6\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.671395 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671235    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-credential-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.671395 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671261    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-certs\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.671395 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671291    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-token\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.671395 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671317    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.671395 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671346    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.671395 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671386    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-token\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671425    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671464    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671493    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-data\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671535    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671543    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671595    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-certs\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671667    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2pzv\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-kube-api-access-g2pzv\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671703    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istiod-ca-cert\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671744    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-data\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.671785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671786    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istiod-ca-cert\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671821    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-podinfo\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671856    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671887    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da51dfef-219c-4058-a1ed-b69e8b08800a-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.671932    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672008    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672041    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672079    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672121    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672161    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdwpq\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-kube-api-access-gdwpq\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672208    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672240    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-podinfo\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672276    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkc8j\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-kube-api-access-zkc8j\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.672440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672325    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-data\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.673161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672589    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-envoy\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.673161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672615    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-certs\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.673161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672626    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.673161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672698    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-credential-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.673161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672772    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.673161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672806    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.673161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672886    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-envoy\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.673161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672915    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.673161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.672915    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.673875    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istiod-ca-cert\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.674070    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.674214    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-data\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.674407    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.674434    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.674532    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-certs\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.674665    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-credential-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.674756    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-certs\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.674806    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-credential-socket\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.675121    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-socket\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.675122    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.675174    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-credential-socket\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.675195    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istiod-ca-cert\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.675377    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.675551    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da51dfef-219c-4058-a1ed-b69e8b08800a-istiod-ca-cert\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.675640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.675600    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-data\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.676915 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.676892    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.677315 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.677247    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-envoy\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.677397 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.677314    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.678192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.678166    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-envoy\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.679025 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.678958    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-podinfo\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.679531 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.679500    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-podinfo\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.679623 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.679604    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-envoy\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.680702 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.680676    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-podinfo\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.733295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.733198    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64dv6\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-kube-api-access-64dv6\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.733295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.733225    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-token\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.733799 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.733774    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkc8j\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-kube-api-access-zkc8j\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.733895 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.733857    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-token\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.734242 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.734219    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:07.734450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.734435    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2pzv\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-kube-api-access-g2pzv\") pod \"e2e-worker-w5-c7d477-openshift-default-776595695-86v24\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") " pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.756378 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.756346    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-token\") pod \"e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") " pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:07.756468 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.756409    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdwpq\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-kube-api-access-gdwpq\") pod \"e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") " pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.809009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.808955    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:07.812938 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.812903    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:07.829057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:07.829028    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:08.054515 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.054435    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:08.270540 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:46:08.270515    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5416c8b_1d9b_41cb_b721_6430b6b5eb4a.slice/crio-61d7cd0d746b2ad73930edcc5b2548b673596623380e9fcd00ce2e90977ac154 WatchSource:0}: Error finding container 61d7cd0d746b2ad73930edcc5b2548b673596623380e9fcd00ce2e90977ac154: Status 404 returned error can't find the container with id 61d7cd0d746b2ad73930edcc5b2548b673596623380e9fcd00ce2e90977ac154
Oct 30 21:46:08.272004 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:46:08.271958    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda51dfef_219c_4058_a1ed_b69e8b08800a.slice/crio-a6afbf9ea9e31ad42d395dbb341ab3cc8b6ee5f448192a85ea767d8a9f61a2cb WatchSource:0}: Error finding container a6afbf9ea9e31ad42d395dbb341ab3cc8b6ee5f448192a85ea767d8a9f61a2cb: Status 404 returned error can't find the container with id a6afbf9ea9e31ad42d395dbb341ab3cc8b6ee5f448192a85ea767d8a9f61a2cb
Oct 30 21:46:08.272131 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.272013    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"]
Oct 30 21:46:08.272131 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.272098    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.272245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.272172    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.272245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.272215    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.273807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.273781    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.273908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.273859    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.274077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.273904    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.274939 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.274915    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.275062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.275040    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.275118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.275079    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.277553 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.277536    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"]
Oct 30 21:46:08.281609 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.281591    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"]
Oct 30 21:46:08.305615 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.305560    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" event={"ID":"da51dfef-219c-4058-a1ed-b69e8b08800a","Type":"ContainerStarted","Data":"a6afbf9ea9e31ad42d395dbb341ab3cc8b6ee5f448192a85ea767d8a9f61a2cb"}
Oct 30 21:46:08.307220 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.307191    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" event={"ID":"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a","Type":"ContainerStarted","Data":"61d7cd0d746b2ad73930edcc5b2548b673596623380e9fcd00ce2e90977ac154"}
Oct 30 21:46:08.308658 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.308625    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" event={"ID":"8d6ef7d2-249f-4d93-af89-15af3a2cebfc","Type":"ContainerStarted","Data":"6cba4780004b2d5e234c5b9226ef6b4fba07fa08581d6b71b03eb4c838ff8168"}
Oct 30 21:46:08.453310 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.451958    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"]
Oct 30 21:46:08.456893 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.456863    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.457084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.457059    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.457165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.457116    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:08.789551 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.789522    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:08.974731 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.974689    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"]
Oct 30 21:46:08.980937 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:08.980909    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.034992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.032161    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"]
Oct 30 21:46:09.080251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.080208    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 21:46:09.080787 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.080767    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 21:46:09.081193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.081175    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9kbqs\""
Oct 30 21:46:09.081360 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.081348    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 21:46:09.133104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.131174    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.134101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.133408    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5z8\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-kube-api-access-4t5z8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.134101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.133734    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.134101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.133779    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.134101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.134083    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.134537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.134227    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.134537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.134263    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.427708 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.427666    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.427999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.427954    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.428131 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.428116    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.428227 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.428211    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5z8\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-kube-api-access-4t5z8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.428382 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.428369    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.428483 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.428469    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.428826 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.428809    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.477086 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.455172    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.477086 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.471630    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.565783 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.565747    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.596279 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.596245    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.694984 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.694882    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.741506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.733149    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5z8\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-kube-api-access-4t5z8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.766426 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.766392    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ncjhl\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.911991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.904503    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" event={"ID":"da51dfef-219c-4058-a1ed-b69e8b08800a","Type":"ContainerStarted","Data":"35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea"}
Oct 30 21:46:09.911991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.910782    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:09.976046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:09.955688    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" event={"ID":"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a","Type":"ContainerStarted","Data":"1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25"}
Oct 30 21:46:10.027322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.014574    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" event={"ID":"f3e39f0f-b5f7-40b9-a089-42ed027b1720","Type":"ContainerStarted","Data":"790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b"}
Oct 30 21:46:10.027322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.014660    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" event={"ID":"f3e39f0f-b5f7-40b9-a089-42ed027b1720","Type":"ContainerStarted","Data":"22b54daf3800ee70810819eea4625ba72a442f0c1b26d0bd6e567f130505f5c1"}
Oct 30 21:46:10.051193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.040065    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" event={"ID":"8d6ef7d2-249f-4d93-af89-15af3a2cebfc","Type":"ContainerStarted","Data":"012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b"}
Oct 30 21:46:10.064080 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.064042    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:10.072001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.065350    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 21:46:10.072284 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.072254    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 21:46:10.082017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.066694    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podStartSLOduration=3.066677454 podStartE2EDuration="3.066677454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:10.06640122 +0000 UTC m=+1371.098249746" watchObservedRunningTime="2026-10-30 21:46:10.066677454 +0000 UTC m=+1371.098525991"
Oct 30 21:46:10.174992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.173926    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:10.232091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.210690    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podStartSLOduration=3.210667693 podStartE2EDuration="3.210667693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:10.204335111 +0000 UTC m=+1371.236183647" watchObservedRunningTime="2026-10-30 21:46:10.210667693 +0000 UTC m=+1371.242516228"
Oct 30 21:46:10.384000 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.383213    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podStartSLOduration=3.383192237 podStartE2EDuration="3.383192237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:10.361724419 +0000 UTC m=+1371.393572956" watchObservedRunningTime="2026-10-30 21:46:10.383192237 +0000 UTC m=+1371.415040772"
Oct 30 21:46:10.438032 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.431041    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:10.482161 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.482059    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:46:10.850152 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.850063    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:10.914000 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.913826    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:46:10.914000 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.913888    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:46:10.914478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.914202    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:10.914478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.914261    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:10.914478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.914355    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-86v24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 21:46:10.914478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.914385    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 21:46:10.914695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.914486    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:46:10.914695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.914515    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:46:10.954112 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:10.954067    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:11.080997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.067751    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:11.117290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.116097    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 21:46:11.117290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.116158    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 21:46:11.327296 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.327237    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podStartSLOduration=4.327217033 podStartE2EDuration="4.327217033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:10.514925782 +0000 UTC m=+1371.546774318" watchObservedRunningTime="2026-10-30 21:46:11.327217033 +0000 UTC m=+1372.359065570"
Oct 30 21:46:11.426990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.405171    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"]
Oct 30 21:46:11.427253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.421200    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:11.432076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.432035    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:11.433303 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.433284    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:46:11.483531 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.483476    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:11.484001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.483977    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:46:11.545856 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.545804    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:11.830052 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.816920    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:46:11.848436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.831129    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:46:11.848436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.831531    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:11.848436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.831868    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-86v24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 21:46:11.848436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.831905    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 21:46:11.848436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.832161    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:46:11.848436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.832190    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:46:11.916317 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.916271    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:11.969222 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.969176    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:46:11.974105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:11.974079    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:46:12.076114 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.076070    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:12.076725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.076701    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:46:12.104197 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.104107    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 21:46:12.104197 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.104170    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 21:46:12.204992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.185667    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:12.360115 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.320310    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:12.634025 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.609086    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:46:12.634025 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.617641    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:46:12.678993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.660719    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:12.702988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.679406    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:46:12.702988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.679479    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:46:12.702988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.693782    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:12.748993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.726877    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:12.845021 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.844954    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:12.941104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.930917    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:46:12.953104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.953055    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:46:12.981992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.936258    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:46:12.982280 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.982240    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:46:12.997993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.961125    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-86v24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 21:46:12.998426 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.998394    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 21:46:13.034247 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.996650    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:13.034247 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.023814    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:46:13.073950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:12.996425    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:46:13.141231 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.081393    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:13.141231 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.081633    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 21:46:13.141231 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.135717    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 21:46:13.141231 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.135769    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 21:46:13.636989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.612444    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:13.937009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.799626    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:13.937243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.799858    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:13.938288 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.851926    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 21:46:13.963073 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.735284    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:13.989280 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.989247    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-86v24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 21:46:13.989531 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.989505    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 21:46:13.989997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:13.989951    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:46:14.019013 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.018950    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:14.039777 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.039745    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:46:14.040061 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.040035    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:46:14.106988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.100617    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:46:14.107280 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.107247    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:46:14.185040 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.175271    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:14.248092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.191880    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 21:46:14.248092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.191940    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 21:46:14.566051 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.538460    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 21:46:14.566051 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.538808    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 21:46:14.666151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.666105    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:14.781573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.774986    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:14.820568 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:46:14.793600    5575 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.654s"
Oct 30 21:46:14.820832 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.820793    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl" event={"ID":"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a","Type":"ContainerStarted","Data":"6f66c6f3b1892568f0836ceed2856c99e58ddb35ddb98a54f502d113a256c201"}
Oct 30 21:46:14.979992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.922154    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:46:14.979992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.922286    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:46:14.979992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.941649    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:14.979992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.942093    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:46:14.979992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.942251    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:46:14.994117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:14.994066    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:15.021937 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.021886    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:15.022712 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.022690    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:46:15.130794 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.130684    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-86v24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 21:46:15.135488 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.135451    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 21:46:15.305124 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.282349    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:46:15.412987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.409990    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:46:15.412987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.410055    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:46:15.412987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.411064    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 21:46:15.412987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.411118    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 21:46:15.791044 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.774354    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 21:46:15.883993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.870000    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:46:15.883993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.870060    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:46:15.883993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.874463    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:46:15.883993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.874505    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:46:15.969992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.942676    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:15.969992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.943004    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 21:46:15.969992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:15.943292    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:46:16.024343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.024280    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:16.026158 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.026123    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:46:16.075047 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.070053    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-86v24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 21:46:16.075047 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.070168    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 21:46:16.200468 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.180302    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:16.240163 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.240105    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:16.332051 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.287873    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:16.400010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.338663    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 21:46:16.400010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.338722    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 21:46:16.426054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.413798    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:16.440221 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:46:16.440189    5575 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.305s"
Oct 30 21:46:16.441872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.441851    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:46:16.778097 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.778052    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:16.804244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.804206    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:16.828202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.828154    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-86v24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 21:46:16.828497 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.828448    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 21:46:16.828719 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.828704    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:46:16.828853 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.828835    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:46:16.831117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.831094    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:46:16.831298 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.831279    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:46:16.997785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.995270    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 21:46:16.997785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:16.996388    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 21:46:17.031277 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.031175    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:17.070383 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.070236    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:17.092238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.092205    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 21:46:17.092635 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.092498    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 21:46:17.665059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.365668    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:17.753110 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.373387    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:17.754164 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.523554    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:46:17.755067 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.755046    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:46:17.760080 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.760045    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:46:17.766016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.760266    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:46:17.812245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.812200    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-86v24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 21:46:17.812614 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.812565    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 21:46:17.818948 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.818924    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:46:17.819147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.819123    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:46:17.830375 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.830352    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:46:17.848521 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.831458    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:46:17.848836 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.848799    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:46:17.858049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.858023    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:46:17.881679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:17.881650    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 21:46:18.068888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:18.068784    5575 patch_prober.go:29] interesting pod/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 21:46:18.068888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:18.068857    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 21:46:19.075007 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.037682    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:19.075007 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.051065    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:19.097865 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.097785    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 21:46:19.597499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.597451    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:19.598560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.598504    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:19.600595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.600572    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:46:19.641034 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.641002    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:19.646553 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.642775    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:19.648395 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.648337    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:46:19.688340 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.688306    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:19.756065 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.754560    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:19.756295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.756275    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:19.758251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:19.758200    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:46:21.738682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:21.738640    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:21.739169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:21.738724    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:22.672005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:22.671950    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl" event={"ID":"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a","Type":"ContainerStarted","Data":"5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1"}
Oct 30 21:46:22.672192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:22.672140    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:22.674560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:22.674531    5575 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-ncjhl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:46:22.674685 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:22.674588    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl" podUID="8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:22.885741 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:22.885693    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl" podStartSLOduration=4.678784111 podStartE2EDuration="14.885678095s" totalImagesPullingTime="10.206893984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:22.842716141 +0000 UTC m=+1383.874564677" watchObservedRunningTime="2026-10-30 21:46:22.885678095 +0000 UTC m=+1383.917526629"
Oct 30 21:46:23.489799 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:46:23.489759    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:46:23.681203 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:23.681172    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:46:24.466661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:24.466627    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:28.635110 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:28.635058    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:46:28.709167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:28.709112    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:28.763179 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:28.763111    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:28.788418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:28.788378    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:28.958057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:28.957127    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:29.012991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.010111    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:29.058995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.038496    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:29.293050 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.291053    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:29.614186 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.603085    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:46:29.614186 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.603156    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:29.658556 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.658502    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:46:29.698990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.673450    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:46:29.761138 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.720056    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:46:29.774141 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.763800    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:29.782995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.774915    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:46:29.783301 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.783280    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:46:29.868087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.811089    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 21:46:29.868087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.841014    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:46:30.105344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:29.961073    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:30.105344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.031816    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:46:30.105344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.077049    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:30.105344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.101275    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:46:30.105344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.103220    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 21:46:30.105344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.103918    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:46:30.254115 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.254083    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 21:46:30.439467 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.438881    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 21:46:30.679835 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.677154    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:30.838802 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.838774    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 21:46:30.864694 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.864642    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:30.865706 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.865673    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:46:30.972537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:30.972426    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:31.054644 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:31.054515    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:31.521409 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:31.521367    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 21:46:31.693379 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:31.693338    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 21:46:31.876487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:31.875587    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:31.877267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:31.877231    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:31.877739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:31.877715    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 21:46:31.888196 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:31.885567    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 21:46:31.950465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:31.950424    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 21:46:32.070548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:32.070513    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f"
Oct 30 21:46:32.091268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:32.091189    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 21:46:36.201693 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:36.201654    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:36.375892 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:36.375738    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:36.796630 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:36.796589    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:38.482021 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:38.481949    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:41.208901 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:41.208864    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:41.385583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:41.385549    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:46.227881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:46.227847    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:46.384543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:46.384514    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:46.545307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:46.545219    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:47.825849 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.825770    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"]
Oct 30 21:46:47.833545 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.833521    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:47.935575 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.935544    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"]
Oct 30 21:46:47.970819 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.970784    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:47.971023 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.970825    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:47.971023 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.970929    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:47.971209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.971187    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a26d33-eb54-483f-8a0f-0951bbeda3db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:47.971266 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.971250    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s96cw\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-kube-api-access-s96cw\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:47.971373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.971351    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:47.971433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.971389    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:47.971433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.971423    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:47.971646 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:47.971623    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073035 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.072996    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a26d33-eb54-483f-8a0f-0951bbeda3db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073221 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073080    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s96cw\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-kube-api-access-s96cw\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073221 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073115    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073221 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073143    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073221 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073171    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073432 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073283    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073432 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073418    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073535 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073446    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073535 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073499    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073448    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073709 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073682    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073779 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073751    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073834 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073798    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a26d33-eb54-483f-8a0f-0951bbeda3db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.073877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.073853    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.075895 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.075843    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.076032 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.076017    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.135287 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.135259    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.135437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.135308    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s96cw\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-kube-api-access-s96cw\") pod \"maas-default-gateway-openshift-default-75d7c785f-6jt65\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.152388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.152366    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:48.601168 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:46:48.601136    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a26d33_eb54_483f_8a0f_0951bbeda3db.slice/crio-7b486ae9d2e35e61c1d735b40a30342cae87e1dcbace463102169c8998811eb3 WatchSource:0}: Error finding container 7b486ae9d2e35e61c1d735b40a30342cae87e1dcbace463102169c8998811eb3: Status 404 returned error can't find the container with id 7b486ae9d2e35e61c1d735b40a30342cae87e1dcbace463102169c8998811eb3
Oct 30 21:46:48.601779 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.601756    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"]
Oct 30 21:46:48.603958 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.603929    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:48.604043 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.604030    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:48.604089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.604063    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:48.667458 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.667404    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:48.962382 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.962338    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" event={"ID":"05a26d33-eb54-483f-8a0f-0951bbeda3db","Type":"ContainerStarted","Data":"23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2"}
Oct 30 21:46:48.962800 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:48.962414    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" event={"ID":"05a26d33-eb54-483f-8a0f-0951bbeda3db","Type":"ContainerStarted","Data":"7b486ae9d2e35e61c1d735b40a30342cae87e1dcbace463102169c8998811eb3"}
Oct 30 21:46:49.150518 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:49.148952    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podStartSLOduration=2.148926759 podStartE2EDuration="2.148926759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:49.088591666 +0000 UTC m=+1410.120440202" watchObservedRunningTime="2026-10-30 21:46:49.148926759 +0000 UTC m=+1410.180775297"
Oct 30 21:46:49.179872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:49.179838    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:46:49.180182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:49.180153    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:46:49.182554 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:49.181482    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:50.153815 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:50.153779    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:46:50.154446 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:50.154409    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:46:51.153751 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:51.153717    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:46:51.154062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:51.154037    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:46:51.446087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:51.446000    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:51.603832 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:51.603561    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:51.766143 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:51.766030    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:52.153316 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:52.153284    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:46:52.153499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:52.153347    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:46:53.153532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:53.153498    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:46:53.154250 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:53.154121    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:46:53.501845 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:46:53.501770    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:46:54.153781 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:54.153738    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:46:54.154219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:54.153818    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:46:54.444680 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:54.444546    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:55.153603 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:55.153573    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:46:55.153782 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:55.153623    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:46:56.153240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:56.153203    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:46:56.153722 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:56.153264    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:46:56.573251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:56.573168    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:57.153606 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:57.153574    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:46:57.159504 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:57.159468    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:46:58.388832 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:58.388799    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:58.390133 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:58.390105    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:58.391954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:58.391934    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 21:46:59.553545 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:46:59.553509    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:01.463352 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:01.463318    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:06.400926 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:06.400883    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:09.244143 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:09.244107    5575 generic.go:356] "Generic (PLEG): container finished" podID="71a40198-99a8-468c-bd13-0d42a577d80c" containerID="60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3" exitCode=0
Oct 30 21:47:09.244607 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:09.244178    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" event={"ID":"71a40198-99a8-468c-bd13-0d42a577d80c","Type":"ContainerDied","Data":"60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3"}
Oct 30 21:47:09.244669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:09.244611    5575 scope.go:122] "RemoveContainer" containerID="60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3"
Oct 30 21:47:09.246384 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:09.246355    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:09.246496 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:09.246421    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:09.246496 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:09.246454    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:10.255629 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:10.255591    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" event={"ID":"71a40198-99a8-468c-bd13-0d42a577d80c","Type":"ContainerStarted","Data":"2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488"}
Oct 30 21:47:10.355421 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:10.355389    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:47:10.355634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:10.355616    5575 patch_prober.go:29] interesting pod/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 21:47:10.355716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:10.355670    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 21:47:11.355864 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:11.355826    5575 patch_prober.go:29] interesting pod/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 21:47:11.356299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:11.355882    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 21:47:11.519992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:11.511538    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:12.355950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:12.355911    5575 patch_prober.go:29] interesting pod/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 21:47:12.356488 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:12.356012    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 21:47:13.356617 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:13.356578    5575 patch_prober.go:29] interesting pod/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 21:47:13.357260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:13.357231    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 21:47:14.355872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:14.355833    5575 patch_prober.go:29] interesting pod/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 21:47:14.356207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:14.356179    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 21:47:15.413076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:15.413045    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:47:15.413891 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:15.413866    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:47:15.414542 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:15.414517    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:47:16.460480 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:16.460444    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:21.299750 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:21.299672    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:23.576989 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:47:23.569174    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:47:26.397477 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:26.397433    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:31.367882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:31.367837    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:34.552855 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:34.552822    5575 generic.go:356] "Generic (PLEG): container finished" podID="73e3621a-248e-460a-bd16-523c4302058b" containerID="3b284a6be81eb2a258ee277cf0810ebcb9a4fd240674c8da4efeaad016937549" exitCode=0
Oct 30 21:47:34.553428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:34.552893    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" event={"ID":"73e3621a-248e-460a-bd16-523c4302058b","Type":"ContainerDied","Data":"3b284a6be81eb2a258ee277cf0810ebcb9a4fd240674c8da4efeaad016937549"}
Oct 30 21:47:34.553428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:34.553399    5575 scope.go:122] "RemoveContainer" containerID="3b284a6be81eb2a258ee277cf0810ebcb9a4fd240674c8da4efeaad016937549"
Oct 30 21:47:34.554902 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:34.554874    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:34.554995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:34.554943    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:34.555039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:34.555015    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:35.602993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:35.602112    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" event={"ID":"73e3621a-248e-460a-bd16-523c4302058b","Type":"ContainerStarted","Data":"0dca5066d0349b17297a4f602cbfad608be6987e1a4e93f1675160b2f3eae458"}
Oct 30 21:47:36.373229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:36.373200    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:47:36.374654 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:36.374627    5575 patch_prober.go:29] interesting pod/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:47:36.374794 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:36.374673    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:47:36.695811 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:36.695773    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:37.372784 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:37.372751    5575 patch_prober.go:29] interesting pod/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:47:37.373005 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:37.372818    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:47:38.372935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:38.372900    5575 patch_prober.go:29] interesting pod/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:47:38.373337 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:38.372960    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:47:39.373584 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:39.373546    5575 patch_prober.go:29] interesting pod/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:47:39.374026 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:39.373618    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:47:40.097671 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:40.097639    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:47:40.372848 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:40.372769    5575 patch_prober.go:29] interesting pod/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:47:40.372848 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:40.372837    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:47:41.377123 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:41.377091    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:47:41.378471 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:41.378448    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:47:41.971266 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:41.971229    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:47.675739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:47.675705    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:49.017689 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:49.017648    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:51.781463 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:51.781429    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:53.162658 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:53.162615    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:53.500443 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:47:53.500355    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:47:55.383646 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:55.383617    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:55.537593 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:55.537551    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:57.723795 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:57.723761    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:58.511661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:47:58.511626    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:03.067866 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:03.067824    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:03.658694 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:03.658643    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:06.277713 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:06.277675    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:06.461195 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:06.461157    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:08.672207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:08.672177    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:08.847543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:08.847505    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:09.022398 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:09.022315    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:13.794070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:13.794037    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:14.432097 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:14.432051    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-6jt65 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:48:14.432300 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:14.432134    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:18.670583 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:18.670536    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:19.430744 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:19.430718    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:48:19.430905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:19.430723    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:48:19.446825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:19.446803    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:48:19.447001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:19.446808    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:48:23.488917 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:48:23.488882    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:48:23.578629 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:23.578597    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:27.805222 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:27.805184    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:29.572462 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:29.572423    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:29.850018 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:29.849914    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:30.028748 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:30.028711    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:34.407289 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:34.407248    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:35.566201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:35.566168    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:35.970322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:35.970273    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:36.265808 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:36.265732    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:37.315819 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:37.315782    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:37.611813 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:37.611725    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:37.804384 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:37.804349    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:38.046229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:38.046202    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:38.699118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:38.699088    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:38.863343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:38.863309    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:39.036700 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:39.036599    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:39.794461 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:39.794349    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:40.449197 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:40.449158    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:41.773086 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:41.773048    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"]
Oct 30 21:48:41.773569 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:41.773297    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy" containerID="cri-o://2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488" gracePeriod=30
Oct 30 21:48:41.782529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:41.782502    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:42.473437 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:42.473400    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:43.381169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:43.381123    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:43.557097 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:43.557042    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:43.721095 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:43.720919    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:44.181668 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:44.181636    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:44.342252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:44.342211    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:45.416504 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:45.416467    5575 patch_prober.go:29] interesting pod/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:48:45.416908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:45.416523    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:48:46.711393 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:46.711353    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:46.930447 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:46.930388    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:47.068279 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.068238    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"]
Oct 30 21:48:47.069151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.069118    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy" containerID="cri-o://0dca5066d0349b17297a4f602cbfad608be6987e1a4e93f1675160b2f3eae458" gracePeriod=30
Oct 30 21:48:47.093818 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.093788    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:47.382953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.382921    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:48:47.459409 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.459373    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-envoy\") pod \"71a40198-99a8-468c-bd13-0d42a577d80c\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") "
Oct 30 21:48:47.460728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.460705    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-socket\") pod \"71a40198-99a8-468c-bd13-0d42a577d80c\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") "
Oct 30 21:48:47.461197 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.461137    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-socket" pod "71a40198-99a8-468c-bd13-0d42a577d80c" (UID: "71a40198-99a8-468c-bd13-0d42a577d80c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:47.461520 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.461504    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-data\") pod \"71a40198-99a8-468c-bd13-0d42a577d80c\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") "
Oct 30 21:48:47.461661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.461643    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/71a40198-99a8-468c-bd13-0d42a577d80c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a40198-99a8-468c-bd13-0d42a577d80c-istio-podinfo\") pod \"71a40198-99a8-468c-bd13-0d42a577d80c\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") "
Oct 30 21:48:47.462420 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.462402    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-certs\") pod \"71a40198-99a8-468c-bd13-0d42a577d80c\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") "
Oct 30 21:48:47.463057 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.463031    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71a40198-99a8-468c-bd13-0d42a577d80c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a40198-99a8-468c-bd13-0d42a577d80c-istiod-ca-cert\") pod \"71a40198-99a8-468c-bd13-0d42a577d80c\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") "
Oct 30 21:48:47.463312 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.462333    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-data" pod "71a40198-99a8-468c-bd13-0d42a577d80c" (UID: "71a40198-99a8-468c-bd13-0d42a577d80c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:47.463381 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.462767    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-certs" pod "71a40198-99a8-468c-bd13-0d42a577d80c" (UID: "71a40198-99a8-468c-bd13-0d42a577d80c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:47.463467 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.463451    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-credential-socket\") pod \"71a40198-99a8-468c-bd13-0d42a577d80c\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") "
Oct 30 21:48:47.463865 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.463851    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-istio-token\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-istio-token\") pod \"71a40198-99a8-468c-bd13-0d42a577d80c\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") "
Oct 30 21:48:47.464033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.463637    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71a40198-99a8-468c-bd13-0d42a577d80c-istiod-ca-cert" pod "71a40198-99a8-468c-bd13-0d42a577d80c" (UID: "71a40198-99a8-468c-bd13-0d42a577d80c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:47.464033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.463776    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-credential-socket" pod "71a40198-99a8-468c-bd13-0d42a577d80c" (UID: "71a40198-99a8-468c-bd13-0d42a577d80c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:47.464230 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.464056    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-kube-api-access-k7cg6\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-kube-api-access-k7cg6\") pod \"71a40198-99a8-468c-bd13-0d42a577d80c\" (UID: \"71a40198-99a8-468c-bd13-0d42a577d80c\") "
Oct 30 21:48:47.465052 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.465036    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:47.465189 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.465177    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:47.465289 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.465279    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:47.465392 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.465381    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a40198-99a8-468c-bd13-0d42a577d80c-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:47.465487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.465476    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:47.486022 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.484890    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-envoy" pod "71a40198-99a8-468c-bd13-0d42a577d80c" (UID: "71a40198-99a8-468c-bd13-0d42a577d80c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:47.486710 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.486678    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71a40198-99a8-468c-bd13-0d42a577d80c-istio-podinfo" pod "71a40198-99a8-468c-bd13-0d42a577d80c" (UID: "71a40198-99a8-468c-bd13-0d42a577d80c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:48:47.488345 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.488314    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-istio-token" pod "71a40198-99a8-468c-bd13-0d42a577d80c" (UID: "71a40198-99a8-468c-bd13-0d42a577d80c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:47.492468 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.492431    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-kube-api-access-k7cg6" pod "71a40198-99a8-468c-bd13-0d42a577d80c" (UID: "71a40198-99a8-468c-bd13-0d42a577d80c"). InnerVolumeSpecName "kube-api-access-k7cg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:47.568410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.568212    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:47.568410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.568262    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7cg6\" (UniqueName: \"kubernetes.io/projected/71a40198-99a8-468c-bd13-0d42a577d80c-kube-api-access-k7cg6\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:47.568410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.568278    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a40198-99a8-468c-bd13-0d42a577d80c-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:47.568410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.568292    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a40198-99a8-468c-bd13-0d42a577d80c-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:47.602328 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.601304    5575 generic.go:356] "Generic (PLEG): container finished" podID="71a40198-99a8-468c-bd13-0d42a577d80c" containerID="2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488" exitCode=0
Oct 30 21:48:47.602924 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.602895    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" event={"ID":"71a40198-99a8-468c-bd13-0d42a577d80c","Type":"ContainerDied","Data":"2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488"}
Oct 30 21:48:47.603158 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.603134    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj" event={"ID":"71a40198-99a8-468c-bd13-0d42a577d80c","Type":"ContainerDied","Data":"152cd641c00ac5aef06a06a5d45e313e274f2f3e4a09f21e8c6faae69cdb9bf1"}
Oct 30 21:48:47.603302 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.603179    5575 scope.go:122] "RemoveContainer" containerID="2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488"
Oct 30 21:48:47.603302 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.602913    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"
Oct 30 21:48:47.630448 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.630418    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:47.634179 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.634071    5575 scope.go:122] "RemoveContainer" containerID="60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3"
Oct 30 21:48:47.674885 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.674857    5575 scope.go:122] "RemoveContainer" containerID="2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488"
Oct 30 21:48:47.675300 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:48:47.675269    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488\": container with ID starting with 2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488 not found: ID does not exist" containerID="2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488"
Oct 30 21:48:47.675376 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.675309    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488"} err="failed to get container status \"2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488\": rpc error: code = NotFound desc = could not find container \"2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488\": container with ID starting with 2b0980e3332f6ee57aef025d951fbbb30f1650038b8b4c481eeb70766fb38488 not found: ID does not exist"
Oct 30 21:48:47.675376 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.675329    5575 scope.go:122] "RemoveContainer" containerID="60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3"
Oct 30 21:48:47.675738 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:48:47.675714    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3\": container with ID starting with 60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3 not found: ID does not exist" containerID="60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3"
Oct 30 21:48:47.675813 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.675744    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3"} err="failed to get container status \"60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3\": rpc error: code = NotFound desc = could not find container \"60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3\": container with ID starting with 60f096cdd0fca3b591ff969d38c5f0930dfc087cf1aa4b5280b69fc4d54147b3 not found: ID does not exist"
Oct 30 21:48:47.777522 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.777471    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"]
Oct 30 21:48:47.784326 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.784302    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1d456a94-openshift-default-7dbcf56f57-zvxlj"]
Oct 30 21:48:47.814448 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:47.814415    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:48.017485 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.017458    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:48.780888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.780857    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"]
Oct 30 21:48:48.781573 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.781558    5575 cpu_manager.go:414] "containerMap: removing container" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy"
Oct 30 21:48:48.781617 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.781574    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy"
Oct 30 21:48:48.781617 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.781595    5575 cpu_manager.go:414] "containerMap: removing container" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy"
Oct 30 21:48:48.781617 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.781600    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy"
Oct 30 21:48:48.781731 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.781722    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy"
Oct 30 21:48:48.781765 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.781735    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" containerName="istio-proxy"
Oct 30 21:48:48.785194 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.785175    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.886988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.886730    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.886988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.886807    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.886988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.886885    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.886988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.886955    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.887343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.887033    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.887343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.887183    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.887343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.887240    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.887343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.887318    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.887613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.887353    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2clq\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-kube-api-access-q2clq\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.893651 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.893624    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"]
Oct 30 21:48:48.934387 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.934356    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:48.989156 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.989103    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.989411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.989176    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.989411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.989254    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.989411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.989286    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2clq\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-kube-api-access-q2clq\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.989411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.989351    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.989753 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.989407    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.989753 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.989489    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.989753 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.989572    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.989753 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.989608    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.994202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.990456    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.994202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.990733    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.994202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.991324    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.994202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.991781    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:48.994202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:48.992048    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:49.013596 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.013567    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:49.017308 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.017280    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:49.054046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.053956    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:49.066682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.066641    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2clq\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-kube-api-access-q2clq\") pod \"maas-default-gateway-openshift-default-75d7c785f-wp768\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:49.098008 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.097974    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:49.147373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.147297    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71a40198-99a8-468c-bd13-0d42a577d80c" path="/var/lib/kubelet/pods/71a40198-99a8-468c-bd13-0d42a577d80c/volumes"
Oct 30 21:48:49.402385 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.402348    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:49.562009 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:48:49.561978    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95080aaa_0f44_42ea_aa2a_1ccddabbdce5.slice/crio-6d0288a5d4c0e6893cccbccbd0f8293bd2af3402b01abcde60c4218689c2a53b WatchSource:0}: Error finding container 6d0288a5d4c0e6893cccbccbd0f8293bd2af3402b01abcde60c4218689c2a53b: Status 404 returned error can't find the container with id 6d0288a5d4c0e6893cccbccbd0f8293bd2af3402b01abcde60c4218689c2a53b
Oct 30 21:48:49.562545 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.562527    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"]
Oct 30 21:48:49.564850 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.564809    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:48:49.564958 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.564902    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:48:49.565030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.564953    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:48:49.622505 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:49.622469    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" event={"ID":"95080aaa-0f44-42ea-aa2a-1ccddabbdce5","Type":"ContainerStarted","Data":"6d0288a5d4c0e6893cccbccbd0f8293bd2af3402b01abcde60c4218689c2a53b"}
Oct 30 21:48:50.647357 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:50.647323    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" event={"ID":"95080aaa-0f44-42ea-aa2a-1ccddabbdce5","Type":"ContainerStarted","Data":"4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271"}
Oct 30 21:48:50.879433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:50.879384    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" podStartSLOduration=2.879370492 podStartE2EDuration="2.879370492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:50.825406957 +0000 UTC m=+1531.857255498" watchObservedRunningTime="2026-10-30 21:48:50.879370492 +0000 UTC m=+1531.911219027"
Oct 30 21:48:51.098455 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:51.098365    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:51.100139 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:51.100109    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wp768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 21:48:51.100268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:51.100161    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 21:48:52.082707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:52.082671    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:52.099035 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:52.099004    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wp768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 21:48:52.099183 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:52.099076    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 21:48:52.390612 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:52.390572    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:52.688320 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:52.688245    5575 generic.go:356] "Generic (PLEG): container finished" podID="73e3621a-248e-460a-bd16-523c4302058b" containerID="0dca5066d0349b17297a4f602cbfad608be6987e1a4e93f1675160b2f3eae458" exitCode=0
Oct 30 21:48:52.688550 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:52.688320    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" event={"ID":"73e3621a-248e-460a-bd16-523c4302058b","Type":"ContainerDied","Data":"0dca5066d0349b17297a4f602cbfad608be6987e1a4e93f1675160b2f3eae458"}
Oct 30 21:48:52.688641 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:52.688629    5575 scope.go:122] "RemoveContainer" containerID="3b284a6be81eb2a258ee277cf0810ebcb9a4fd240674c8da4efeaad016937549"
Oct 30 21:48:52.966746 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:52.966670    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:48:53.084675 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.084631    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-socket\") pod \"73e3621a-248e-460a-bd16-523c4302058b\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") "
Oct 30 21:48:53.085586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.084717    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/73e3621a-248e-460a-bd16-523c4302058b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73e3621a-248e-460a-bd16-523c4302058b-istio-podinfo\") pod \"73e3621a-248e-460a-bd16-523c4302058b\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") "
Oct 30 21:48:53.085586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.084748    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-istio-token\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-istio-token\") pod \"73e3621a-248e-460a-bd16-523c4302058b\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") "
Oct 30 21:48:53.085586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.084788    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-kube-api-access-z52n4\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-kube-api-access-z52n4\") pod \"73e3621a-248e-460a-bd16-523c4302058b\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") "
Oct 30 21:48:53.085586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.084933    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-socket" pod "73e3621a-248e-460a-bd16-523c4302058b" (UID: "73e3621a-248e-460a-bd16-523c4302058b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:53.085586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.085412    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-data\") pod \"73e3621a-248e-460a-bd16-523c4302058b\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") "
Oct 30 21:48:53.085870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.085634    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-envoy\") pod \"73e3621a-248e-460a-bd16-523c4302058b\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") "
Oct 30 21:48:53.085870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.085684    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-certs\") pod \"73e3621a-248e-460a-bd16-523c4302058b\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") "
Oct 30 21:48:53.085870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.085723    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-credential-socket\") pod \"73e3621a-248e-460a-bd16-523c4302058b\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") "
Oct 30 21:48:53.085870 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.085784    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/73e3621a-248e-460a-bd16-523c4302058b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73e3621a-248e-460a-bd16-523c4302058b-istiod-ca-cert\") pod \"73e3621a-248e-460a-bd16-523c4302058b\" (UID: \"73e3621a-248e-460a-bd16-523c4302058b\") "
Oct 30 21:48:53.087217 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.086624    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-data" pod "73e3621a-248e-460a-bd16-523c4302058b" (UID: "73e3621a-248e-460a-bd16-523c4302058b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:53.087217 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.086733    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-certs" pod "73e3621a-248e-460a-bd16-523c4302058b" (UID: "73e3621a-248e-460a-bd16-523c4302058b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:53.087217 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.086815    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-credential-socket" pod "73e3621a-248e-460a-bd16-523c4302058b" (UID: "73e3621a-248e-460a-bd16-523c4302058b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:53.087217 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.087106    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:53.087217 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.087148    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e3621a-248e-460a-bd16-523c4302058b-istiod-ca-cert" pod "73e3621a-248e-460a-bd16-523c4302058b" (UID: "73e3621a-248e-460a-bd16-523c4302058b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:53.087217 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.087164    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:53.087217 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.087180    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:53.087217 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.087194    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:53.089577 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.089544    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-istio-token" pod "73e3621a-248e-460a-bd16-523c4302058b" (UID: "73e3621a-248e-460a-bd16-523c4302058b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:53.090271 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.090129    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73e3621a-248e-460a-bd16-523c4302058b-istio-podinfo" pod "73e3621a-248e-460a-bd16-523c4302058b" (UID: "73e3621a-248e-460a-bd16-523c4302058b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:48:53.090271 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.090242    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-kube-api-access-z52n4" pod "73e3621a-248e-460a-bd16-523c4302058b" (UID: "73e3621a-248e-460a-bd16-523c4302058b"). InnerVolumeSpecName "kube-api-access-z52n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:53.091041 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.091019    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-envoy" pod "73e3621a-248e-460a-bd16-523c4302058b" (UID: "73e3621a-248e-460a-bd16-523c4302058b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:53.105028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.104593    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wp768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 21:48:53.105028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.104644    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 21:48:53.190078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.189884    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73e3621a-248e-460a-bd16-523c4302058b-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:53.190078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.189920    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73e3621a-248e-460a-bd16-523c4302058b-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:53.190078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.189935    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:53.190078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.189950    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z52n4\" (UniqueName: \"kubernetes.io/projected/73e3621a-248e-460a-bd16-523c4302058b-kube-api-access-z52n4\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:53.190078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.189985    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73e3621a-248e-460a-bd16-523c4302058b-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:53.491151 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:48:53.491110    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:48:53.698263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.698237    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"
Oct 30 21:48:53.698444 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.698277    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99" event={"ID":"73e3621a-248e-460a-bd16-523c4302058b","Type":"ContainerDied","Data":"384e3bb0b35b0d12be1e93605fc34ebb1de0a55094bbf70a51608156ea6dfb17"}
Oct 30 21:48:53.698444 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.698331    5575 scope.go:122] "RemoveContainer" containerID="0dca5066d0349b17297a4f602cbfad608be6987e1a4e93f1675160b2f3eae458"
Oct 30 21:48:53.867579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.867551    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"]
Oct 30 21:48:53.943997 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:53.943167    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e6f16377-openshift-default-774bdf68c-g8s99"]
Oct 30 21:48:54.098470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:54.098394    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wp768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 21:48:54.098470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:54.098444    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 21:48:54.497553 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:54.497512    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:55.099101 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:55.099072    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wp768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 21:48:55.099486 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:55.099128    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 21:48:55.149877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:55.149843    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73e3621a-248e-460a-bd16-523c4302058b" path="/var/lib/kubelet/pods/73e3621a-248e-460a-bd16-523c4302058b/volumes"
Oct 30 21:48:56.098492 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:56.098449    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wp768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 21:48:56.098703 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:56.098511    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 21:48:57.098539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:57.098496    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wp768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 21:48:57.098955 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:57.098560    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 21:48:58.083804 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:58.083762    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:58.282586 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:58.282540    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:58.464314 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:58.463288    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:58.464314 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:58.464123    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:58.464931 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:58.464908    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 21:48:59.790172 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:48:59.790093    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:04.750420 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:04.750385    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:07.965169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:07.965130    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:09.673582 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:09.673549    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:13.340274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:13.340235    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:13.917042 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:13.917006    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"]
Oct 30 21:49:13.919212 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:13.919185    5575 cpu_manager.go:414] "containerMap: removing container" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy"
Oct 30 21:49:13.919397 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:13.919383    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy"
Oct 30 21:49:13.919548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:13.919536    5575 cpu_manager.go:414] "containerMap: removing container" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy"
Oct 30 21:49:13.919685 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:13.919673    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy"
Oct 30 21:49:13.919950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:13.919935    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy"
Oct 30 21:49:13.920120 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:13.920108    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="73e3621a-248e-460a-bd16-523c4302058b" containerName="istio-proxy"
Oct 30 21:49:13.947193 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:13.947163    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.009988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.006495    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w0-2c8f56-openshift-default-dockercfg-msvqg\""
Oct 30 21:49:14.017949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.017900    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:14.156418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.156383    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-envoy\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.156698 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.156677    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-socket\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.156852 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.156825    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-data\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.156991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.156959    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5391e528-4cac-4c13-9148-e9eb152ed874-istiod-ca-cert\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.157134 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.157120    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-certs\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.157232 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.157220    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-credential-socket\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.157798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.157458    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-794dl\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-kube-api-access-794dl\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.158154 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.158132    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5391e528-4cac-4c13-9148-e9eb152ed874-istio-podinfo\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.158292 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.158278    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-istio-token\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.159042 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.159017    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"]
Oct 30 21:49:14.260106 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260021    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-data\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260106 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260080    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5391e528-4cac-4c13-9148-e9eb152ed874-istiod-ca-cert\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260383 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260122    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-certs\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260383 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260153    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-credential-socket\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260383 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260312    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-794dl\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-kube-api-access-794dl\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260536 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260471    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-data\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260536 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260486    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5391e528-4cac-4c13-9148-e9eb152ed874-istio-podinfo\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260536 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260528    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-certs\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260531    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-istio-token\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260614    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-envoy\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260617    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-credential-socket\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.260898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.260692    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-socket\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.261230 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.261032    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-socket\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.261230 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.261077    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5391e528-4cac-4c13-9148-e9eb152ed874-istiod-ca-cert\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.263024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.262953    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-envoy\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.263272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.263253    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5391e528-4cac-4c13-9148-e9eb152ed874-istio-podinfo\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.338602 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.338502    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-istio-token\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.340727 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.340705    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-794dl\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-kube-api-access-794dl\") pod \"e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") " pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.427436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.427406    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:14.484598 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.484513    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:14.735900 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.735867    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:14.899036 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.899009    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:14.906122 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:49:14.906091    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5391e528_4cac_4c13_9148_e9eb152ed874.slice/crio-355c181c96f91bb1b8bae42129d758b329046c49669b689e3648251e111a755f WatchSource:0}: Error finding container 355c181c96f91bb1b8bae42129d758b329046c49669b689e3648251e111a755f: Status 404 returned error can't find the container with id 355c181c96f91bb1b8bae42129d758b329046c49669b689e3648251e111a755f
Oct 30 21:49:14.906426 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.906406    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"]
Oct 30 21:49:14.911041 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.910947    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:49:14.911128 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.911091    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:49:14.911165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:14.911138    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:49:15.055801 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:15.055653    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:15.180919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:15.180837    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" event={"ID":"5391e528-4cac-4c13-9148-e9eb152ed874","Type":"ContainerStarted","Data":"9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0"}
Oct 30 21:49:15.180919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:15.180896    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" event={"ID":"5391e528-4cac-4c13-9148-e9eb152ed874","Type":"ContainerStarted","Data":"355c181c96f91bb1b8bae42129d758b329046c49669b689e3648251e111a755f"}
Oct 30 21:49:15.303946 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:15.303886    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" podStartSLOduration=2.303868096 podStartE2EDuration="2.303868096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:15.301072422 +0000 UTC m=+1556.332920957" watchObservedRunningTime="2026-10-30 21:49:15.303868096 +0000 UTC m=+1556.335716634"
Oct 30 21:49:15.446043 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:15.435731    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:15.459015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:15.455048    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:16.189527 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:16.189492    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:16.190397 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:16.190375    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:49:18.173651 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:18.173595    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:18.410526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:18.410495    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:20.117131 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:20.117091    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:21.311174 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:21.311143    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:21.464182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:21.464149    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:21.645081 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:21.645040    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:21.844283 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:21.844239    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"]
Oct 30 21:49:21.850759 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:21.850730    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:21.918305 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:21.918209    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"]
Oct 30 21:49:21.957052 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:21.956953    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w0-2c8f56-dockercfg-8gjd5\""
Oct 30 21:49:21.957425 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:21.957408    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w0-2c8f56\""
Oct 30 21:49:22.006359 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.006329    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:22.008472 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.008440    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpts7\" (UniqueName: \"kubernetes.io/projected/529fb24b-6b8f-426a-adff-749192f21652-kube-api-access-zpts7\") pod \"payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx\" (UID: \"529fb24b-6b8f-426a-adff-749192f21652\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:22.008625 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.008552    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fb24b-6b8f-426a-adff-749192f21652-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx\" (UID: \"529fb24b-6b8f-426a-adff-749192f21652\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:22.060263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.060225    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"]
Oct 30 21:49:22.066427 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.066400    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:22.069803 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.069782    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"]
Oct 30 21:49:22.135206 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.115224    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpts7\" (UniqueName: \"kubernetes.io/projected/529fb24b-6b8f-426a-adff-749192f21652-kube-api-access-zpts7\") pod \"payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx\" (UID: \"529fb24b-6b8f-426a-adff-749192f21652\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:22.135547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.135507    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fb24b-6b8f-426a-adff-749192f21652-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx\" (UID: \"529fb24b-6b8f-426a-adff-749192f21652\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:22.136631 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.136604    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fb24b-6b8f-426a-adff-749192f21652-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx\" (UID: \"529fb24b-6b8f-426a-adff-749192f21652\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:22.189064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.188843    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpts7\" (UniqueName: \"kubernetes.io/projected/529fb24b-6b8f-426a-adff-749192f21652-kube-api-access-zpts7\") pod \"payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx\" (UID: \"529fb24b-6b8f-426a-adff-749192f21652\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:22.208158 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.207320    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:22.238600 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.238549    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjkbk\" (UniqueName: \"kubernetes.io/projected/870682b8-47fa-4b93-8c6a-3aebef115d87-kube-api-access-rjkbk\") pod \"payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4\" (UID: \"870682b8-47fa-4b93-8c6a-3aebef115d87\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:22.239591 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.239568    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870682b8-47fa-4b93-8c6a-3aebef115d87-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4\" (UID: \"870682b8-47fa-4b93-8c6a-3aebef115d87\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:22.345627 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.345585    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870682b8-47fa-4b93-8c6a-3aebef115d87-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4\" (UID: \"870682b8-47fa-4b93-8c6a-3aebef115d87\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:22.346248 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.345870    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjkbk\" (UniqueName: \"kubernetes.io/projected/870682b8-47fa-4b93-8c6a-3aebef115d87-kube-api-access-rjkbk\") pod \"payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4\" (UID: \"870682b8-47fa-4b93-8c6a-3aebef115d87\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:22.347332 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.347305    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870682b8-47fa-4b93-8c6a-3aebef115d87-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4\" (UID: \"870682b8-47fa-4b93-8c6a-3aebef115d87\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:22.408244 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.408215    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjkbk\" (UniqueName: \"kubernetes.io/projected/870682b8-47fa-4b93-8c6a-3aebef115d87-kube-api-access-rjkbk\") pod \"payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4\" (UID: \"870682b8-47fa-4b93-8c6a-3aebef115d87\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:22.444394 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.444323    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:22.467996 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.467939    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:22.695118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.695030    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:22.855171 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:22.855080    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"]
Oct 30 21:49:22.858032 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:49:22.857956    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529fb24b_6b8f_426a_adff_749192f21652.slice/crio-98e9b6273074ab6d51e9ea53042d63fdabf55d547a2edbc5b5b68a5312c14e67 WatchSource:0}: Error finding container 98e9b6273074ab6d51e9ea53042d63fdabf55d547a2edbc5b5b68a5312c14e67: Status 404 returned error can't find the container with id 98e9b6273074ab6d51e9ea53042d63fdabf55d547a2edbc5b5b68a5312c14e67
Oct 30 21:49:23.083616 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.083585    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"]
Oct 30 21:49:23.083758 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:49:23.083678    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870682b8_47fa_4b93_8c6a_3aebef115d87.slice/crio-3848270795d75c85c560d40d55f4eddc1b1b2f92b31316b3be33023f78d9e44e WatchSource:0}: Error finding container 3848270795d75c85c560d40d55f4eddc1b1b2f92b31316b3be33023f78d9e44e: Status 404 returned error can't find the container with id 3848270795d75c85c560d40d55f4eddc1b1b2f92b31316b3be33023f78d9e44e
Oct 30 21:49:23.258421 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.258381    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4" event={"ID":"870682b8-47fa-4b93-8c6a-3aebef115d87","Type":"ContainerStarted","Data":"181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09"}
Oct 30 21:49:23.258614 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.258451    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4" event={"ID":"870682b8-47fa-4b93-8c6a-3aebef115d87","Type":"ContainerStarted","Data":"3848270795d75c85c560d40d55f4eddc1b1b2f92b31316b3be33023f78d9e44e"}
Oct 30 21:49:23.258614 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.258566    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:23.260271 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.260249    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx" event={"ID":"529fb24b-6b8f-426a-adff-749192f21652","Type":"ContainerStarted","Data":"6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e"}
Oct 30 21:49:23.260271 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.260285    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx" event={"ID":"529fb24b-6b8f-426a-adff-749192f21652","Type":"ContainerStarted","Data":"98e9b6273074ab6d51e9ea53042d63fdabf55d547a2edbc5b5b68a5312c14e67"}
Oct 30 21:49:23.260434 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.260304    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:23.374086 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.373997    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4" podStartSLOduration=2.373946126 podStartE2EDuration="2.373946126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:23.373542685 +0000 UTC m=+1564.405391221" watchObservedRunningTime="2026-10-30 21:49:23.373946126 +0000 UTC m=+1564.405794658"
Oct 30 21:49:23.514234 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.514178    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx" podStartSLOduration=2.514159286 podStartE2EDuration="2.514159286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:23.493382295 +0000 UTC m=+1564.525230832" watchObservedRunningTime="2026-10-30 21:49:23.514159286 +0000 UTC m=+1564.546007821"
Oct 30 21:49:23.518376 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:49:23.518345    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:49:23.568295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:23.568249    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:25.413519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:25.413479    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:25.568786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:25.568755    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:25.731643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:25.731552    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:28.640407 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:28.640361    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:28.797167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:28.797130    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:30.415563 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:30.415506    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:30.803889 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:30.803814    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:34.272880 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:34.272851    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 21:49:34.273385 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:34.272918    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 21:49:35.602107 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.602078    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"]
Oct 30 21:49:35.607247 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.607221    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.710269 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.710232    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-fd496e14-serving-cert\""
Oct 30 21:49:35.715215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.715189    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"]
Oct 30 21:49:35.750731 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.750698    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-maas-api-tls\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.750892 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.750771    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-metrics-certs\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.750955 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.750904    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4a8735-fe12-4654-b4cd-8b655081057f-openshift-service-ca\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.751044 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.751024    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvhzl\" (UniqueName: \"kubernetes.io/projected/2d4a8735-fe12-4654-b4cd-8b655081057f-kube-api-access-wvhzl\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.808850 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.808820    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:35.853195 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.853104    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-maas-api-tls\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.853367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.853187    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-metrics-certs\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.853367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.853243    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4a8735-fe12-4654-b4cd-8b655081057f-openshift-service-ca\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.853367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.853293    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvhzl\" (UniqueName: \"kubernetes.io/projected/2d4a8735-fe12-4654-b4cd-8b655081057f-kube-api-access-wvhzl\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.854254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.854221    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4a8735-fe12-4654-b4cd-8b655081057f-openshift-service-ca\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.856122 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.856097    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-metrics-certs\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.856414 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.856389    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-maas-api-tls\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.915064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.915034    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvhzl\" (UniqueName: \"kubernetes.io/projected/2d4a8735-fe12-4654-b4cd-8b655081057f-kube-api-access-wvhzl\") pod \"maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.924096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.924071    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:35.975278 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:35.975238    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:36.135725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:36.135581    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:36.316603 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:49:36.316572    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4a8735_fe12_4654_b4cd_8b655081057f.slice/crio-efecbb11e5de948e207782b1937cb0e9bc688adb0e614f58c7b1decc47b9ed0e WatchSource:0}: Error finding container efecbb11e5de948e207782b1937cb0e9bc688adb0e614f58c7b1decc47b9ed0e: Status 404 returned error can't find the container with id efecbb11e5de948e207782b1937cb0e9bc688adb0e614f58c7b1decc47b9ed0e
Oct 30 21:49:36.316743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:36.316667    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"]
Oct 30 21:49:36.379780 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:36.379752    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp" event={"ID":"2d4a8735-fe12-4654-b4cd-8b655081057f","Type":"ContainerStarted","Data":"efecbb11e5de948e207782b1937cb0e9bc688adb0e614f58c7b1decc47b9ed0e"}
Oct 30 21:49:37.391655 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:37.391622    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp" event={"ID":"2d4a8735-fe12-4654-b4cd-8b655081057f","Type":"ContainerStarted","Data":"7b3082003b7541ef6662a6efd1d9fe90367023633ba0bb21398ae7288e8220d3"}
Oct 30 21:49:37.392194 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:37.391811    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:37.513442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:37.513382    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp" podStartSLOduration=1.689633876 podStartE2EDuration="2.513364406s" totalImagesPullingTime="823.73053ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:37.509471328 +0000 UTC m=+1578.541319864" watchObservedRunningTime="2026-10-30 21:49:37.513364406 +0000 UTC m=+1578.545212943"
Oct 30 21:49:40.882902 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:40.882864    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:43.405670 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:43.405640    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:49:46.056904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:46.054105    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:49.805474 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:49.805422    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:51.357410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:51.357374    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:53.472995 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:53.472939    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:53.491118 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:49:53.491078    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:49:53.696178 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:53.696147    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:56.387213 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:49:56.387179    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:01.324227 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:01.324179    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:04.006133 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:04.006102    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:05.001890 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:05.001853    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:05.328041 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:05.325751    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:06.275726 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:06.275692    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:07.895228 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:07.895200    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"]
Oct 30 21:50:07.895695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:07.895459    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy" containerID="cri-o://21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f" gracePeriod=30
Oct 30 21:50:10.853948 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:10.853913    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"]
Oct 30 21:50:10.859354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:10.859333    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:10.917151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:10.917120    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"]
Oct 30 21:50:10.959251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:10.959226    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w0-2c8f56-serving-cert\""
Oct 30 21:50:10.971082 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:10.971057    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17ca55b8-7545-4c28-b0c3-97618de3dd3f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:10.971224 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:10.971169    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:10.971296 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:10.971274    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:10.971401 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:10.971387    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8h94\" (UniqueName: \"kubernetes.io/projected/17ca55b8-7545-4c28-b0c3-97618de3dd3f-kube-api-access-g8h94\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.054742 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.054711    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:11.072867 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.072837    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.073105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.072899    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.073105 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:50:11.073032    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-serving-cert: secret "maas-api-e2e-shared-a-w0-2c8f56-serving-cert" not found
Oct 30 21:50:11.073105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.073055    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8h94\" (UniqueName: \"kubernetes.io/projected/17ca55b8-7545-4c28-b0c3-97618de3dd3f-kube-api-access-g8h94\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.073276 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:50:11.073113    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls podName:17ca55b8-7545-4c28-b0c3-97618de3dd3f nodeName:}" failed. No retries permitted until 2026-10-30 21:50:11.573091635 +0000 UTC m=+1612.604940162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls") pod "maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7" (UID: "17ca55b8-7545-4c28-b0c3-97618de3dd3f") : secret "maas-api-e2e-shared-a-w0-2c8f56-serving-cert" not found
Oct 30 21:50:11.073365 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.073335    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17ca55b8-7545-4c28-b0c3-97618de3dd3f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.074116 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.074093    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17ca55b8-7545-4c28-b0c3-97618de3dd3f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.075832 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.075813    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.138825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.138778    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8h94\" (UniqueName: \"kubernetes.io/projected/17ca55b8-7545-4c28-b0c3-97618de3dd3f-kube-api-access-g8h94\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.241056 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.241021    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:11.416191 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.416097    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:11.581532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.581497    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.584318 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.584294    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:11.774771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:11.774690    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:12.179770 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:50:12.179739    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ca55b8_7545_4c28_b0c3_97618de3dd3f.slice/crio-ae9b6ffb808c298ac9f8772bd8695b45560f451071e62b709abdd5259f44877a WatchSource:0}: Error finding container ae9b6ffb808c298ac9f8772bd8695b45560f451071e62b709abdd5259f44877a: Status 404 returned error can't find the container with id ae9b6ffb808c298ac9f8772bd8695b45560f451071e62b709abdd5259f44877a
Oct 30 21:50:12.181033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:12.181010    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"]
Oct 30 21:50:12.870242 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:12.870196    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7" event={"ID":"17ca55b8-7545-4c28-b0c3-97618de3dd3f","Type":"ContainerStarted","Data":"ae9b6ffb808c298ac9f8772bd8695b45560f451071e62b709abdd5259f44877a"}
Oct 30 21:50:13.218750 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.218724    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:50:13.309650 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.309618    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-data\") pod \"398b47c1-8101-4b4c-9504-2fffb1cee382\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") "
Oct 30 21:50:13.309818 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.309696    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-certs\") pod \"398b47c1-8101-4b4c-9504-2fffb1cee382\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") "
Oct 30 21:50:13.309818 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.309752    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-token\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-token\") pod \"398b47c1-8101-4b4c-9504-2fffb1cee382\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") "
Oct 30 21:50:13.309818 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.309806    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/398b47c1-8101-4b4c-9504-2fffb1cee382-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b47c1-8101-4b4c-9504-2fffb1cee382-istiod-ca-cert\") pod \"398b47c1-8101-4b4c-9504-2fffb1cee382\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") "
Oct 30 21:50:13.310033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.309927    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-podinfo\") pod \"398b47c1-8101-4b4c-9504-2fffb1cee382\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") "
Oct 30 21:50:13.310033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.309937    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-certs" pod "398b47c1-8101-4b4c-9504-2fffb1cee382" (UID: "398b47c1-8101-4b4c-9504-2fffb1cee382"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:13.310033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.309946    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-data" pod "398b47c1-8101-4b4c-9504-2fffb1cee382" (UID: "398b47c1-8101-4b4c-9504-2fffb1cee382"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:13.310033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310000    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-envoy\") pod \"398b47c1-8101-4b4c-9504-2fffb1cee382\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") "
Oct 30 21:50:13.310229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310050    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-kube-api-access-vr29h\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-kube-api-access-vr29h\") pod \"398b47c1-8101-4b4c-9504-2fffb1cee382\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") "
Oct 30 21:50:13.310229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310140    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-socket\") pod \"398b47c1-8101-4b4c-9504-2fffb1cee382\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") "
Oct 30 21:50:13.310348 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310245    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-credential-socket\") pod \"398b47c1-8101-4b4c-9504-2fffb1cee382\" (UID: \"398b47c1-8101-4b4c-9504-2fffb1cee382\") "
Oct 30 21:50:13.310348 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310253    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398b47c1-8101-4b4c-9504-2fffb1cee382-istiod-ca-cert" pod "398b47c1-8101-4b4c-9504-2fffb1cee382" (UID: "398b47c1-8101-4b4c-9504-2fffb1cee382"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:50:13.310471 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310441    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-socket" pod "398b47c1-8101-4b4c-9504-2fffb1cee382" (UID: "398b47c1-8101-4b4c-9504-2fffb1cee382"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:13.310613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310592    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-credential-socket" pod "398b47c1-8101-4b4c-9504-2fffb1cee382" (UID: "398b47c1-8101-4b4c-9504-2fffb1cee382"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:13.310917 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310902    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:13.310953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310920    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:13.310953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310930    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b47c1-8101-4b4c-9504-2fffb1cee382-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:13.310953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310940    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:13.310953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.310948    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:13.313049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.313025    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-envoy" pod "398b47c1-8101-4b4c-9504-2fffb1cee382" (UID: "398b47c1-8101-4b4c-9504-2fffb1cee382"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:13.313049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.313025    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-podinfo" pod "398b47c1-8101-4b4c-9504-2fffb1cee382" (UID: "398b47c1-8101-4b4c-9504-2fffb1cee382"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:50:13.313194 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.313089    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-kube-api-access-vr29h" pod "398b47c1-8101-4b4c-9504-2fffb1cee382" (UID: "398b47c1-8101-4b4c-9504-2fffb1cee382"). InnerVolumeSpecName "kube-api-access-vr29h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:50:13.313194 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.313129    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-token" pod "398b47c1-8101-4b4c-9504-2fffb1cee382" (UID: "398b47c1-8101-4b4c-9504-2fffb1cee382"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:50:13.413706 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.413665    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:13.413706 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.413705    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:13.413899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.413721    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b47c1-8101-4b4c-9504-2fffb1cee382-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:13.413899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.413765    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr29h\" (UniqueName: \"kubernetes.io/projected/398b47c1-8101-4b4c-9504-2fffb1cee382-kube-api-access-vr29h\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:13.881028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.880996    5575 generic.go:356] "Generic (PLEG): container finished" podID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerID="21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f" exitCode=0
Oct 30 21:50:13.881211 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.881064    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"
Oct 30 21:50:13.881211 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.881085    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" event={"ID":"398b47c1-8101-4b4c-9504-2fffb1cee382","Type":"ContainerDied","Data":"21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f"}
Oct 30 21:50:13.881211 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.881168    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5" event={"ID":"398b47c1-8101-4b4c-9504-2fffb1cee382","Type":"ContainerDied","Data":"05e12e1a5e235046669e9a18a768676b696da820968764bd2cced9ee5b247619"}
Oct 30 21:50:13.881211 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.881197    5575 scope.go:122] "RemoveContainer" containerID="21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f"
Oct 30 21:50:13.888094 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.888068    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7" event={"ID":"17ca55b8-7545-4c28-b0c3-97618de3dd3f","Type":"ContainerStarted","Data":"b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e"}
Oct 30 21:50:13.888291 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.888271    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:13.896439 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.896419    5575 scope.go:122] "RemoveContainer" containerID="21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f"
Oct 30 21:50:13.896771 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:50:13.896749    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f\": container with ID starting with 21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f not found: ID does not exist" containerID="21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f"
Oct 30 21:50:13.896852 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:13.896778    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f"} err="failed to get container status \"21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f\": rpc error: code = NotFound desc = could not find container \"21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f\": container with ID starting with 21182efe203ae2acf2761238baa7369191686d06562ee4df72ca342cd31e305f not found: ID does not exist"
Oct 30 21:50:14.071071 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:14.071026    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"]
Oct 30 21:50:14.119104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:14.119063    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-8f4l5"]
Oct 30 21:50:15.051045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:15.050999    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7" podStartSLOduration=4.302794917 podStartE2EDuration="5.050984281s" totalImagesPullingTime="748.189364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:14.224563641 +0000 UTC m=+1615.256412177" watchObservedRunningTime="2026-10-30 21:50:15.050984281 +0000 UTC m=+1616.082832815"
Oct 30 21:50:15.054718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:15.054693    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"]
Oct 30 21:50:15.104392 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:15.104367    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4caf4e3b-qxp9k"]
Oct 30 21:50:15.127647 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:15.127624    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e030c96-10cd-4593-8667-63f5f47e95f7" path="/var/lib/kubelet/pods/0e030c96-10cd-4593-8667-63f5f47e95f7/volumes"
Oct 30 21:50:15.128126 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:15.128110    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" path="/var/lib/kubelet/pods/398b47c1-8101-4b4c-9504-2fffb1cee382/volumes"
Oct 30 21:50:16.360494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:16.360464    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:17.831340 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:17.831286    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:18.065106 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:18.065076    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:18.067349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:18.067327    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"]
Oct 30 21:50:18.114539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:18.114460    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-334c8256-4dth5"]
Oct 30 21:50:18.271489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:18.271459    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:19.129272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:19.129243    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54fb8140-12ac-4465-bd3b-c415968282c6" path="/var/lib/kubelet/pods/54fb8140-12ac-4465-bd3b-c415968282c6/volumes"
Oct 30 21:50:19.904716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:19.904688    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 21:50:21.649553 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:21.649493    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:22.006216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.006121    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:22.220108 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.220077    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:22.426264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.426225    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"]
Oct 30 21:50:22.427443 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.427416    5575 cpu_manager.go:414] "containerMap: removing container" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy"
Oct 30 21:50:22.427443 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.427442    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy"
Oct 30 21:50:22.427899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.427650    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="398b47c1-8101-4b4c-9504-2fffb1cee382" containerName="istio-proxy"
Oct 30 21:50:22.436791 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.436764    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:22.533991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.518867    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca17539c-7cf8-48bf-b168-a20d208aae98-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq\" (UID: \"ca17539c-7cf8-48bf-b168-a20d208aae98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:22.534299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.534269    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl4ns\" (UniqueName: \"kubernetes.io/projected/ca17539c-7cf8-48bf-b168-a20d208aae98-kube-api-access-rl4ns\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq\" (UID: \"ca17539c-7cf8-48bf-b168-a20d208aae98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:22.544068 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.532034    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"]
Oct 30 21:50:22.571703 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.571662    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-71a3d788\""
Oct 30 21:50:22.574137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.574085    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-71a3d788-dockercfg-hnhkj\""
Oct 30 21:50:22.581154 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.580846    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"]
Oct 30 21:50:22.612017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.611309    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:22.641725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.636030    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca17539c-7cf8-48bf-b168-a20d208aae98-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq\" (UID: \"ca17539c-7cf8-48bf-b168-a20d208aae98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:22.642650 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.642613    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl4ns\" (UniqueName: \"kubernetes.io/projected/ca17539c-7cf8-48bf-b168-a20d208aae98-kube-api-access-rl4ns\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq\" (UID: \"ca17539c-7cf8-48bf-b168-a20d208aae98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:22.642766 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.642696    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"]
Oct 30 21:50:22.643640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.643616    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca17539c-7cf8-48bf-b168-a20d208aae98-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq\" (UID: \"ca17539c-7cf8-48bf-b168-a20d208aae98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:22.730317 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.729196    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl4ns\" (UniqueName: \"kubernetes.io/projected/ca17539c-7cf8-48bf-b168-a20d208aae98-kube-api-access-rl4ns\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq\" (UID: \"ca17539c-7cf8-48bf-b168-a20d208aae98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:22.745468 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.745358    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvnf\" (UniqueName: \"kubernetes.io/projected/af55c619-d523-465c-8ee5-1de76ad781ac-kube-api-access-ffvnf\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf\" (UID: \"af55c619-d523-465c-8ee5-1de76ad781ac\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:22.745806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.745780    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af55c619-d523-465c-8ee5-1de76ad781ac-plugins-config-volume\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf\" (UID: \"af55c619-d523-465c-8ee5-1de76ad781ac\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:22.808922 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.808880    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:22.856084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.856049    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvnf\" (UniqueName: \"kubernetes.io/projected/af55c619-d523-465c-8ee5-1de76ad781ac-kube-api-access-ffvnf\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf\" (UID: \"af55c619-d523-465c-8ee5-1de76ad781ac\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:22.856455 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.856423    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af55c619-d523-465c-8ee5-1de76ad781ac-plugins-config-volume\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf\" (UID: \"af55c619-d523-465c-8ee5-1de76ad781ac\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:22.857786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.857763    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af55c619-d523-465c-8ee5-1de76ad781ac-plugins-config-volume\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf\" (UID: \"af55c619-d523-465c-8ee5-1de76ad781ac\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:22.946240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:22.946187    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvnf\" (UniqueName: \"kubernetes.io/projected/af55c619-d523-465c-8ee5-1de76ad781ac-kube-api-access-ffvnf\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf\" (UID: \"af55c619-d523-465c-8ee5-1de76ad781ac\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:23.238531 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:23.238440    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:23.330010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:23.329713    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"]
Oct 30 21:50:23.330119 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:50:23.330000    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca17539c_7cf8_48bf_b168_a20d208aae98.slice/crio-933744f99f53167c68284f726b6c1c8105fb39a101012ecccf729136e8bf4ef6 WatchSource:0}: Error finding container 933744f99f53167c68284f726b6c1c8105fb39a101012ecccf729136e8bf4ef6: Status 404 returned error can't find the container with id 933744f99f53167c68284f726b6c1c8105fb39a101012ecccf729136e8bf4ef6
Oct 30 21:50:23.488134 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:50:23.488100    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:50:23.623070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:23.623039    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"]
Oct 30 21:50:23.623359 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:50:23.623330    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf55c619_d523_465c_8ee5_1de76ad781ac.slice/crio-39933ff8a806e872ed5cab046f561a346c907760e6e99b83a1eeea421537e109 WatchSource:0}: Error finding container 39933ff8a806e872ed5cab046f561a346c907760e6e99b83a1eeea421537e109: Status 404 returned error can't find the container with id 39933ff8a806e872ed5cab046f561a346c907760e6e99b83a1eeea421537e109
Oct 30 21:50:23.992378 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:23.992341    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf" event={"ID":"af55c619-d523-465c-8ee5-1de76ad781ac","Type":"ContainerStarted","Data":"83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6"}
Oct 30 21:50:23.992806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:23.992409    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:23.992806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:23.992437    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf" event={"ID":"af55c619-d523-465c-8ee5-1de76ad781ac","Type":"ContainerStarted","Data":"39933ff8a806e872ed5cab046f561a346c907760e6e99b83a1eeea421537e109"}
Oct 30 21:50:23.994016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:23.993992    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq" event={"ID":"ca17539c-7cf8-48bf-b168-a20d208aae98","Type":"ContainerStarted","Data":"7157c2bb2f8123412c628c16118f539abdb74f708adf1667189f5371edfcd52b"}
Oct 30 21:50:23.994142 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:23.994033    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq" event={"ID":"ca17539c-7cf8-48bf-b168-a20d208aae98","Type":"ContainerStarted","Data":"933744f99f53167c68284f726b6c1c8105fb39a101012ecccf729136e8bf4ef6"}
Oct 30 21:50:23.994142 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:23.994053    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:24.117330 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:24.117272    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf" podStartSLOduration=2.117255184 podStartE2EDuration="2.117255184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:24.109681151 +0000 UTC m=+1625.141529687" watchObservedRunningTime="2026-10-30 21:50:24.117255184 +0000 UTC m=+1625.149103721"
Oct 30 21:50:24.228499 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:24.228410    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq" podStartSLOduration=2.228391677 podStartE2EDuration="2.228391677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:24.225521844 +0000 UTC m=+1625.257370382" watchObservedRunningTime="2026-10-30 21:50:24.228391677 +0000 UTC m=+1625.260240214"
Oct 30 21:50:26.253561 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:26.253512    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:31.793059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:31.789936    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:35.004998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:35.004937    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:50:35.005398 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:35.005039    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:50:37.092062 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:37.092030    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:38.357324 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:38.357291    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:40.029858 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:40.029817    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:40.189842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:40.189775    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:42.879331 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:42.879241    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:43.288486 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:43.288452    5575 generic.go:356] "Generic (PLEG): container finished" podID="5391e528-4cac-4c13-9148-e9eb152ed874" containerID="9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0" exitCode=0
Oct 30 21:50:43.288711 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:43.288526    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" event={"ID":"5391e528-4cac-4c13-9148-e9eb152ed874","Type":"ContainerDied","Data":"9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0"}
Oct 30 21:50:43.289082 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:43.289063    5575 scope.go:122] "RemoveContainer" containerID="9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0"
Oct 30 21:50:43.290741 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:43.290714    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:50:43.290851 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:43.290799    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:50:43.290915 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:43.290849    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:50:44.298761 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:44.298726    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" event={"ID":"5391e528-4cac-4c13-9148-e9eb152ed874","Type":"ContainerStarted","Data":"c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e"}
Oct 30 21:50:44.429991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:44.429874    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:50:44.430194 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:44.430027    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:50:44.430194 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:44.430091    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:50:44.767496 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:44.767464    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:44.999562 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:44.999493    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:45.164299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.164257    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:45.330492 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.330449    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:45.433224 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.433120    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:50:45.433515 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.433464    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:50:45.754551 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.754475    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"]
Oct 30 21:50:45.760004 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.759940    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:45.848469 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.848432    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-259e81-openshift-default-dockercfg-6zkx5\""
Oct 30 21:50:45.871426 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.871394    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:45.988012 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.982931    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-certs\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:45.988012 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.983049    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-token\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:45.988012 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.983106    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-envoy\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:45.988012 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.983179    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-data\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:45.988012 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.983283    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-credential-socket\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:45.988012 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.983405    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-podinfo\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:45.988012 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.983472    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istiod-ca-cert\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:45.988012 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.983546    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkkwx\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-kube-api-access-vkkwx\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:45.988012 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:45.983589    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-socket\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.110923 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.110825    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:46.123017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.122383    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkkwx\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-kube-api-access-vkkwx\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.123017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.122458    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-socket\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.123017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.122526    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-certs\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.123017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.122602    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-token\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.123017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.122664    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-envoy\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.123017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.122762    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-data\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.123490 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.123415    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-certs\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.125124 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.125075    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-data\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.125514 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.125493    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-socket\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.157450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.153134    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-credential-socket\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.157450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.153289    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-podinfo\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.157450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.153366    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istiod-ca-cert\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.157450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.154175    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istiod-ca-cert\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.157450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.154400    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-credential-socket\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.172082 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.171846    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-podinfo\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.172082 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.171950    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"]
Oct 30 21:50:46.207996 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.192313    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:50:46.305462 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.304701    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkkwx\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-kube-api-access-vkkwx\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.318934 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.318635    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-envoy\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.330047 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.329942    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-token\") pod \"e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") " pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.398252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.398220    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:46.448768 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.448734    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:50:46.449048 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.449017    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:50:46.940941 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.940911    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"]
Oct 30 21:50:46.942752 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:50:46.942723    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9b9295_3acd_4cb9_8d87_32560888e3cf.slice/crio-b5987ece5b799700d20385e6be8e77dc8786e60f152e85c9376d8d9a8fc91482 WatchSource:0}: Error finding container b5987ece5b799700d20385e6be8e77dc8786e60f152e85c9376d8d9a8fc91482: Status 404 returned error can't find the container with id b5987ece5b799700d20385e6be8e77dc8786e60f152e85c9376d8d9a8fc91482
Oct 30 21:50:46.945595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.945565    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:50:46.945671 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.945633    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:50:46.945710 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:46.945670    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:50:47.425991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:47.419261    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" event={"ID":"fa9b9295-3acd-4cb9-8d87-32560888e3cf","Type":"ContainerStarted","Data":"e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922"}
Oct 30 21:50:47.425991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:47.419326    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" event={"ID":"fa9b9295-3acd-4cb9-8d87-32560888e3cf","Type":"ContainerStarted","Data":"b5987ece5b799700d20385e6be8e77dc8786e60f152e85c9376d8d9a8fc91482"}
Oct 30 21:50:47.445430 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:47.443114    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:50:47.445430 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:47.443177    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:50:47.542846 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:47.542794    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" podStartSLOduration=2.542779837 podStartE2EDuration="2.542779837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:47.540272755 +0000 UTC m=+1648.572121289" watchObservedRunningTime="2026-10-30 21:50:47.542779837 +0000 UTC m=+1648.574628371"
Oct 30 21:50:48.399023 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:48.398953    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:48.405842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:48.405808    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:48.432991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:48.432659    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:50:48.432991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:48.432716    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:50:48.442977 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:48.442941    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:48.443672 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:48.443651    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:50:48.450074 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:48.450050    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:48.679634 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:48.679444    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:48.872991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:48.862509    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:49.434999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:49.434826    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:50:49.434999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:49.434892    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:50:50.156994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:50.156945    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:50.365014 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:50.364960    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:50.432783 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:50.432704    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:50:50.434024 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:50.434003    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 21:50:50.636080 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:50.636037    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:50.802800 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:50.802699    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:50.959641 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:50.959606    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:52.776241 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:52.776203    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:52.932380 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:52.932345    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:53.487404 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:50:53.487370    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:50:53.804237 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:53.804160    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:54.015700 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:54.015664    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:54.363517 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:54.363471    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:56.586205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:56.586174    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:56.819343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:56.819308    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:58.282380 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:58.282333    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:58.435529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:58.435463    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:59.334091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:59.334055    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:59.918541 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:50:59.918504    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:00.282041 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:00.281878    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:05.078298 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:05.078237    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:08.047786 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:08.047752    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"]
Oct 30 21:51:08.048349 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:08.047985    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy" containerID="cri-o://1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703" gracePeriod=30
Oct 30 21:51:08.374668 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:08.374590    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"]
Oct 30 21:51:08.374811 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:08.374771    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy" containerID="cri-o://e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2" gracePeriod=30
Oct 30 21:51:08.502602 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:08.502570    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"]
Oct 30 21:51:08.502838 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:08.502813    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy" containerID="cri-o://f4b9351f25a509a3c8d643dfd7e4df5bf75640ebcf4aa430f6babe8bbaf86162" gracePeriod=30
Oct 30 21:51:10.056510 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:10.056476    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:13.369449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.369417    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:51:13.387578 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387550    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-data\") pod \"773cbca6-4b1a-403a-856e-1f73b28431d3\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") "
Oct 30 21:51:13.387737 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387589    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-certs\") pod \"773cbca6-4b1a-403a-856e-1f73b28431d3\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") "
Oct 30 21:51:13.387737 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387656    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-socket\") pod \"773cbca6-4b1a-403a-856e-1f73b28431d3\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") "
Oct 30 21:51:13.387737 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387703    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-credential-socket\") pod \"773cbca6-4b1a-403a-856e-1f73b28431d3\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") "
Oct 30 21:51:13.387904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387746    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-podinfo\") pod \"773cbca6-4b1a-403a-856e-1f73b28431d3\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") "
Oct 30 21:51:13.387904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387794    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/773cbca6-4b1a-403a-856e-1f73b28431d3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cbca6-4b1a-403a-856e-1f73b28431d3-istiod-ca-cert\") pod \"773cbca6-4b1a-403a-856e-1f73b28431d3\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") "
Oct 30 21:51:13.387904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387806    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-data" pod "773cbca6-4b1a-403a-856e-1f73b28431d3" (UID: "773cbca6-4b1a-403a-856e-1f73b28431d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.387904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387832    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-certs" pod "773cbca6-4b1a-403a-856e-1f73b28431d3" (UID: "773cbca6-4b1a-403a-856e-1f73b28431d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.387904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387844    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-token\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-token\") pod \"773cbca6-4b1a-403a-856e-1f73b28431d3\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") "
Oct 30 21:51:13.388192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.387910    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-envoy\") pod \"773cbca6-4b1a-403a-856e-1f73b28431d3\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") "
Oct 30 21:51:13.388192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.388042    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-credential-socket" pod "773cbca6-4b1a-403a-856e-1f73b28431d3" (UID: "773cbca6-4b1a-403a-856e-1f73b28431d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.388192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.388064    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-kube-api-access-ddzqz\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-kube-api-access-ddzqz\") pod \"773cbca6-4b1a-403a-856e-1f73b28431d3\" (UID: \"773cbca6-4b1a-403a-856e-1f73b28431d3\") "
Oct 30 21:51:13.388192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.388126    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-socket" pod "773cbca6-4b1a-403a-856e-1f73b28431d3" (UID: "773cbca6-4b1a-403a-856e-1f73b28431d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.388394 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.388234    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773cbca6-4b1a-403a-856e-1f73b28431d3-istiod-ca-cert" pod "773cbca6-4b1a-403a-856e-1f73b28431d3" (UID: "773cbca6-4b1a-403a-856e-1f73b28431d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:13.388843 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.388821    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.389059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.389042    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.389159 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.389148    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.389430 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.389413    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.389529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.389518    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cbca6-4b1a-403a-856e-1f73b28431d3-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.390940 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.390911    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-token" pod "773cbca6-4b1a-403a-856e-1f73b28431d3" (UID: "773cbca6-4b1a-403a-856e-1f73b28431d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:13.391508 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.391474    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-kube-api-access-ddzqz" pod "773cbca6-4b1a-403a-856e-1f73b28431d3" (UID: "773cbca6-4b1a-403a-856e-1f73b28431d3"). InnerVolumeSpecName "kube-api-access-ddzqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:13.392171 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.392145    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-podinfo" pod "773cbca6-4b1a-403a-856e-1f73b28431d3" (UID: "773cbca6-4b1a-403a-856e-1f73b28431d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:13.392921 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.392897    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-envoy" pod "773cbca6-4b1a-403a-856e-1f73b28431d3" (UID: "773cbca6-4b1a-403a-856e-1f73b28431d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.491677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.491647    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.491677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.491680    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.491877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.491694    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cbca6-4b1a-403a-856e-1f73b28431d3-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.491877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.491708    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddzqz\" (UniqueName: \"kubernetes.io/projected/773cbca6-4b1a-403a-856e-1f73b28431d3-kube-api-access-ddzqz\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.744668 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.744286    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:51:13.801222 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.801194    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-kube-api-access-6w972\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-kube-api-access-6w972\") pod \"cb8144e9-393d-40d7-bb6b-38532daa080f\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") "
Oct 30 21:51:13.801361 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.801322    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-envoy\") pod \"cb8144e9-393d-40d7-bb6b-38532daa080f\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") "
Oct 30 21:51:13.801416 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.801388    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cb8144e9-393d-40d7-bb6b-38532daa080f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8144e9-393d-40d7-bb6b-38532daa080f-istiod-ca-cert\") pod \"cb8144e9-393d-40d7-bb6b-38532daa080f\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") "
Oct 30 21:51:13.801465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.801441    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-socket\") pod \"cb8144e9-393d-40d7-bb6b-38532daa080f\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") "
Oct 30 21:51:13.801543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.801526    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-data\") pod \"cb8144e9-393d-40d7-bb6b-38532daa080f\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") "
Oct 30 21:51:13.801653 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.801640    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-credential-socket\") pod \"cb8144e9-393d-40d7-bb6b-38532daa080f\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") "
Oct 30 21:51:13.801733 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.801721    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-podinfo\") pod \"cb8144e9-393d-40d7-bb6b-38532daa080f\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") "
Oct 30 21:51:13.801901 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.801838    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8144e9-393d-40d7-bb6b-38532daa080f-istiod-ca-cert" pod "cb8144e9-393d-40d7-bb6b-38532daa080f" (UID: "cb8144e9-393d-40d7-bb6b-38532daa080f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:13.802179 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.802027    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-credential-socket" pod "cb8144e9-393d-40d7-bb6b-38532daa080f" (UID: "cb8144e9-393d-40d7-bb6b-38532daa080f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.802179 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.802132    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-socket" pod "cb8144e9-393d-40d7-bb6b-38532daa080f" (UID: "cb8144e9-393d-40d7-bb6b-38532daa080f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.802322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.802233    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-token\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-token\") pod \"cb8144e9-393d-40d7-bb6b-38532daa080f\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") "
Oct 30 21:51:13.802322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.802262    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-data" pod "cb8144e9-393d-40d7-bb6b-38532daa080f" (UID: "cb8144e9-393d-40d7-bb6b-38532daa080f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.802322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.802279    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-certs\") pod \"cb8144e9-393d-40d7-bb6b-38532daa080f\" (UID: \"cb8144e9-393d-40d7-bb6b-38532daa080f\") "
Oct 30 21:51:13.802626 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.802603    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-certs" pod "cb8144e9-393d-40d7-bb6b-38532daa080f" (UID: "cb8144e9-393d-40d7-bb6b-38532daa080f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.803066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.803049    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.803066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.803073    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.803182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.803088    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.803182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.803101    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8144e9-393d-40d7-bb6b-38532daa080f-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.803182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.803114    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.804898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.804873    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-podinfo" pod "cb8144e9-393d-40d7-bb6b-38532daa080f" (UID: "cb8144e9-393d-40d7-bb6b-38532daa080f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:13.805090 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.805071    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-kube-api-access-6w972" pod "cb8144e9-393d-40d7-bb6b-38532daa080f" (UID: "cb8144e9-393d-40d7-bb6b-38532daa080f"). InnerVolumeSpecName "kube-api-access-6w972". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:13.806276 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.806249    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-envoy" pod "cb8144e9-393d-40d7-bb6b-38532daa080f" (UID: "cb8144e9-393d-40d7-bb6b-38532daa080f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.806465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.806445    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-token" pod "cb8144e9-393d-40d7-bb6b-38532daa080f" (UID: "cb8144e9-393d-40d7-bb6b-38532daa080f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:13.825173 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.825140    5575 generic.go:356] "Generic (PLEG): container finished" podID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerID="1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703" exitCode=0
Oct 30 21:51:13.825354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.825210    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"
Oct 30 21:51:13.825354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.825224    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" event={"ID":"773cbca6-4b1a-403a-856e-1f73b28431d3","Type":"ContainerDied","Data":"1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703"}
Oct 30 21:51:13.825354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.825291    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb" event={"ID":"773cbca6-4b1a-403a-856e-1f73b28431d3","Type":"ContainerDied","Data":"452711b397709186b026e4e8078f95a9174b22cc78b03f73d5682ed204c71d7b"}
Oct 30 21:51:13.825354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.825322    5575 scope.go:122] "RemoveContainer" containerID="1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703"
Oct 30 21:51:13.825533 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.825517    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:51:13.828385 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.828355    5575 generic.go:356] "Generic (PLEG): container finished" podID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerID="f4b9351f25a509a3c8d643dfd7e4df5bf75640ebcf4aa430f6babe8bbaf86162" exitCode=0
Oct 30 21:51:13.828528 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.828448    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" event={"ID":"3a1151f8-169a-43ed-8c22-c0106b68049d","Type":"ContainerDied","Data":"f4b9351f25a509a3c8d643dfd7e4df5bf75640ebcf4aa430f6babe8bbaf86162"}
Oct 30 21:51:13.849549 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.849511    5575 generic.go:356] "Generic (PLEG): container finished" podID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerID="e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2" exitCode=0
Oct 30 21:51:13.849836 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.849785    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" event={"ID":"cb8144e9-393d-40d7-bb6b-38532daa080f","Type":"ContainerDied","Data":"e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2"}
Oct 30 21:51:13.850046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.850026    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k" event={"ID":"cb8144e9-393d-40d7-bb6b-38532daa080f","Type":"ContainerDied","Data":"d6231446eb725fc221d231246515bd2f144d42e1df02846f91130f91d0740018"}
Oct 30 21:51:13.850419 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.850379    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"
Oct 30 21:51:13.856844 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.856819    5575 scope.go:122] "RemoveContainer" containerID="1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703"
Oct 30 21:51:13.860242 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:13.860208    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703\": container with ID starting with 1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703 not found: ID does not exist" containerID="1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703"
Oct 30 21:51:13.860341 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.860253    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703"} err="failed to get container status \"1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703\": rpc error: code = NotFound desc = could not find container \"1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703\": container with ID starting with 1375e44ba71a273a1b6540e86da3b2f755b57afa701791cd95283991f19fb703 not found: ID does not exist"
Oct 30 21:51:13.862456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.860275    5575 scope.go:122] "RemoveContainer" containerID="f4b9351f25a509a3c8d643dfd7e4df5bf75640ebcf4aa430f6babe8bbaf86162"
Oct 30 21:51:13.892720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.892697    5575 scope.go:122] "RemoveContainer" containerID="e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2"
Oct 30 21:51:13.904612 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.904586    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3a1151f8-169a-43ed-8c22-c0106b68049d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a1151f8-169a-43ed-8c22-c0106b68049d-istiod-ca-cert\") pod \"3a1151f8-169a-43ed-8c22-c0106b68049d\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") "
Oct 30 21:51:13.904743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.904709    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-socket\") pod \"3a1151f8-169a-43ed-8c22-c0106b68049d\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") "
Oct 30 21:51:13.904908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.904892    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-certs\") pod \"3a1151f8-169a-43ed-8c22-c0106b68049d\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") "
Oct 30 21:51:13.905008 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.904928    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-kube-api-access-v5dkl\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-kube-api-access-v5dkl\") pod \"3a1151f8-169a-43ed-8c22-c0106b68049d\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") "
Oct 30 21:51:13.905091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.905073    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-podinfo\") pod \"3a1151f8-169a-43ed-8c22-c0106b68049d\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") "
Oct 30 21:51:13.905149 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.905135    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-envoy\") pod \"3a1151f8-169a-43ed-8c22-c0106b68049d\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") "
Oct 30 21:51:13.905207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.905178    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-token\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-token\") pod \"3a1151f8-169a-43ed-8c22-c0106b68049d\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") "
Oct 30 21:51:13.905306 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.905292    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-data\") pod \"3a1151f8-169a-43ed-8c22-c0106b68049d\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") "
Oct 30 21:51:13.905413 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.905399    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-credential-socket\") pod \"3a1151f8-169a-43ed-8c22-c0106b68049d\" (UID: \"3a1151f8-169a-43ed-8c22-c0106b68049d\") "
Oct 30 21:51:13.906308 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.906286    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.906413 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.906315    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.906413 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.906332    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w972\" (UniqueName: \"kubernetes.io/projected/cb8144e9-393d-40d7-bb6b-38532daa080f-kube-api-access-6w972\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.906413 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.906346    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8144e9-393d-40d7-bb6b-38532daa080f-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:13.906721 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.906605    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-credential-socket" pod "3a1151f8-169a-43ed-8c22-c0106b68049d" (UID: "3a1151f8-169a-43ed-8c22-c0106b68049d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.907118 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.907094    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-certs" pod "3a1151f8-169a-43ed-8c22-c0106b68049d" (UID: "3a1151f8-169a-43ed-8c22-c0106b68049d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.907559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.907311    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-socket" pod "3a1151f8-169a-43ed-8c22-c0106b68049d" (UID: "3a1151f8-169a-43ed-8c22-c0106b68049d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.907559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.907531    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-data" pod "3a1151f8-169a-43ed-8c22-c0106b68049d" (UID: "3a1151f8-169a-43ed-8c22-c0106b68049d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.907895 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.907806    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a1151f8-169a-43ed-8c22-c0106b68049d-istiod-ca-cert" pod "3a1151f8-169a-43ed-8c22-c0106b68049d" (UID: "3a1151f8-169a-43ed-8c22-c0106b68049d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:13.908019 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.907940    5575 scope.go:122] "RemoveContainer" containerID="e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2"
Oct 30 21:51:13.908322 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:13.908293    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2\": container with ID starting with e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2 not found: ID does not exist" containerID="e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2"
Oct 30 21:51:13.908388 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.908333    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2"} err="failed to get container status \"e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2\": rpc error: code = NotFound desc = could not find container \"e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2\": container with ID starting with e53a417688b5a692c053452c69dc5f5707c88ad161dc3e89e500f8ef9edfd5b2 not found: ID does not exist"
Oct 30 21:51:13.909843 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.909821    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-kube-api-access-v5dkl" pod "3a1151f8-169a-43ed-8c22-c0106b68049d" (UID: "3a1151f8-169a-43ed-8c22-c0106b68049d"). InnerVolumeSpecName "kube-api-access-v5dkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:13.910043 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.910023    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-token" pod "3a1151f8-169a-43ed-8c22-c0106b68049d" (UID: "3a1151f8-169a-43ed-8c22-c0106b68049d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:13.911285 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.911262    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-podinfo" pod "3a1151f8-169a-43ed-8c22-c0106b68049d" (UID: "3a1151f8-169a-43ed-8c22-c0106b68049d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:13.911828 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.911808    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-envoy" pod "3a1151f8-169a-43ed-8c22-c0106b68049d" (UID: "3a1151f8-169a-43ed-8c22-c0106b68049d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:13.985001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.984950    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"]
Oct 30 21:51:13.989286 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:13.989266    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-6hklb"]
Oct 30 21:51:14.007925 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.007891    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:14.008084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.007928    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5dkl\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-kube-api-access-v5dkl\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:14.008084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.007947    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:14.008084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.007960    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:14.008084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.007990    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:14.008084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.008001    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:14.008084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.008014    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:14.008084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.008027    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a1151f8-169a-43ed-8c22-c0106b68049d-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:14.008084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.008040    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a1151f8-169a-43ed-8c22-c0106b68049d-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:14.271804 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.271712    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"]
Oct 30 21:51:14.281560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.281515    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-92r2k"]
Oct 30 21:51:14.860990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.860944    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"
Oct 30 21:51:14.861565 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:14.861406    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl" event={"ID":"3a1151f8-169a-43ed-8c22-c0106b68049d","Type":"ContainerDied","Data":"3947de964d5a0980d89dd0158ba0f3ef59c8ebd9f8353bf66d69b7e074ae6b3f"}
Oct 30 21:51:15.032179 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:15.032135    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"]
Oct 30 21:51:15.080697 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:15.080666    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-xkdbl"]
Oct 30 21:51:15.092522 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:15.092476    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:15.166589 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:15.165030    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" path="/var/lib/kubelet/pods/3a1151f8-169a-43ed-8c22-c0106b68049d/volumes"
Oct 30 21:51:15.166589 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:15.165902    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" path="/var/lib/kubelet/pods/773cbca6-4b1a-403a-856e-1f73b28431d3/volumes"
Oct 30 21:51:15.166882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:15.166817    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" path="/var/lib/kubelet/pods/cb8144e9-393d-40d7-bb6b-38532daa080f/volumes"
Oct 30 21:51:15.298645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:15.298610    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:15.454670 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:15.454545    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:19.589153 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:19.589126    5575 scope.go:122] "RemoveContainer" containerID="aaa76c3eb66e888902c9567ee4c40a82130fd48acfdf70f3ec4d5a03da60790b"
Oct 30 21:51:19.621133 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:19.621113    5575 scope.go:122] "RemoveContainer" containerID="88f58a56d3ee7ef6fda0691ee7a2a183127cc4ac87fa45c82926fbfba560513c"
Oct 30 21:51:20.543048 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:20.543009    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:20.696296 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:20.696222    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:21.157428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:21.157395    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:21.969463 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:21.967255    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:22.497159 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:22.497129    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:23.505059 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:23.497605    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:51:24.911544 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:24.911508    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:26.371555 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:26.371520    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:26.638804 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:26.638764    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:26.914407 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:26.914324    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:27.089278 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:27.089242    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:27.303560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:27.303470    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:27.630579 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:27.630496    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:27.853987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:27.853337    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:28.019703 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:28.019664    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:28.184991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:28.182413    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:28.764993 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:28.761554    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:29.288587 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:29.288552    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:30.975280 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:30.975239    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:31.215821 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:31.215759    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:32.042506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.042465    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"]
Oct 30 21:51:32.043013 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.042748    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp" podUID="2d4a8735-fe12-4654-b4cd-8b655081057f" containerName="maas-api" containerID="cri-o://7b3082003b7541ef6662a6efd1d9fe90367023633ba0bb21398ae7288e8220d3" gracePeriod=30
Oct 30 21:51:32.156852 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.156824    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:32.254990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.250862    5575 generic.go:356] "Generic (PLEG): container finished" podID="2d4a8735-fe12-4654-b4cd-8b655081057f" containerID="7b3082003b7541ef6662a6efd1d9fe90367023633ba0bb21398ae7288e8220d3" exitCode=0
Oct 30 21:51:32.254990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.251093    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp" event={"ID":"2d4a8735-fe12-4654-b4cd-8b655081057f","Type":"ContainerDied","Data":"7b3082003b7541ef6662a6efd1d9fe90367023633ba0bb21398ae7288e8220d3"}
Oct 30 21:51:32.403599 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.403567    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:51:32.520510 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.520482    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d4a8735-fe12-4654-b4cd-8b655081057f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4a8735-fe12-4654-b4cd-8b655081057f-openshift-service-ca\") pod \"2d4a8735-fe12-4654-b4cd-8b655081057f\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") "
Oct 30 21:51:32.520718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.520521    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-maas-api-tls\") pod \"2d4a8735-fe12-4654-b4cd-8b655081057f\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") "
Oct 30 21:51:32.520718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.520574    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d4a8735-fe12-4654-b4cd-8b655081057f-kube-api-access-wvhzl\" (UniqueName: \"kubernetes.io/projected/2d4a8735-fe12-4654-b4cd-8b655081057f-kube-api-access-wvhzl\") pod \"2d4a8735-fe12-4654-b4cd-8b655081057f\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") "
Oct 30 21:51:32.520718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.520710    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-metrics-certs\") pod \"2d4a8735-fe12-4654-b4cd-8b655081057f\" (UID: \"2d4a8735-fe12-4654-b4cd-8b655081057f\") "
Oct 30 21:51:32.520907 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.520880    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d4a8735-fe12-4654-b4cd-8b655081057f-openshift-service-ca" pod "2d4a8735-fe12-4654-b4cd-8b655081057f" (UID: "2d4a8735-fe12-4654-b4cd-8b655081057f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:32.521461 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.521436    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4a8735-fe12-4654-b4cd-8b655081057f-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:32.528526 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.528466    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-metrics-certs" pod "2d4a8735-fe12-4654-b4cd-8b655081057f" (UID: "2d4a8735-fe12-4654-b4cd-8b655081057f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:51:32.530699 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.530667    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4a8735-fe12-4654-b4cd-8b655081057f-kube-api-access-wvhzl" pod "2d4a8735-fe12-4654-b4cd-8b655081057f" (UID: "2d4a8735-fe12-4654-b4cd-8b655081057f"). InnerVolumeSpecName "kube-api-access-wvhzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:32.530699 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.530678    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-maas-api-tls" pod "2d4a8735-fe12-4654-b4cd-8b655081057f" (UID: "2d4a8735-fe12-4654-b4cd-8b655081057f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:51:32.623249 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.623177    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:32.623249 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.623210    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvhzl\" (UniqueName: \"kubernetes.io/projected/2d4a8735-fe12-4654-b4cd-8b655081057f-kube-api-access-wvhzl\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:32.623249 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.623227    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4a8735-fe12-4654-b4cd-8b655081057f-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:32.944781 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:32.944748    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:33.266243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:33.266102    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"
Oct 30 21:51:33.266243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:33.266114    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp" event={"ID":"2d4a8735-fe12-4654-b4cd-8b655081057f","Type":"ContainerDied","Data":"efecbb11e5de948e207782b1937cb0e9bc688adb0e614f58c7b1decc47b9ed0e"}
Oct 30 21:51:33.266243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:33.266187    5575 scope.go:122] "RemoveContainer" containerID="7b3082003b7541ef6662a6efd1d9fe90367023633ba0bb21398ae7288e8220d3"
Oct 30 21:51:33.435379 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:33.435347    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"]
Oct 30 21:51:33.439449 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:33.439428    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fd496e14-65b985d99c-fh7bp"]
Oct 30 21:51:33.884125 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:33.884092    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:34.112376 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:34.112339    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:34.266729 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:34.266634    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:34.497181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:34.497152    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:34.900137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:34.900092    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:35.080185 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:35.080148    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:35.129887 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:35.129855    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d4a8735-fe12-4654-b4cd-8b655081057f" path="/var/lib/kubelet/pods/2d4a8735-fe12-4654-b4cd-8b655081057f/volumes"
Oct 30 21:51:35.272825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:35.272741    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:35.445844 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:35.445791    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:36.088061 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:36.077262    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:36.618606 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:36.618559    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:38.285169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.285130    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:38.451385 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.451354    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:38.622536 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.622448    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"]
Oct 30 21:51:38.622721 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.622693    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy" containerID="cri-o://9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824" gracePeriod=30
Oct 30 21:51:38.701640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.701598    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"]
Oct 30 21:51:38.702718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.702677    5575 cpu_manager.go:414] "containerMap: removing container" podUID="2d4a8735-fe12-4654-b4cd-8b655081057f" containerName="maas-api"
Oct 30 21:51:38.702922 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.702904    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d4a8735-fe12-4654-b4cd-8b655081057f" containerName="maas-api"
Oct 30 21:51:38.703183 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.703166    5575 cpu_manager.go:414] "containerMap: removing container" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy"
Oct 30 21:51:38.703301 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.703287    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy"
Oct 30 21:51:38.703432 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.703412    5575 cpu_manager.go:414] "containerMap: removing container" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy"
Oct 30 21:51:38.703520 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.703509    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy"
Oct 30 21:51:38.703638 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.703626    5575 cpu_manager.go:414] "containerMap: removing container" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy"
Oct 30 21:51:38.703736 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.703716    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy"
Oct 30 21:51:38.704045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.704020    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d4a8735-fe12-4654-b4cd-8b655081057f" containerName="maas-api"
Oct 30 21:51:38.704899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.704868    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a1151f8-169a-43ed-8c22-c0106b68049d" containerName="istio-proxy"
Oct 30 21:51:38.705051 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.705037    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb8144e9-393d-40d7-bb6b-38532daa080f" containerName="istio-proxy"
Oct 30 21:51:38.705172 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.705156    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="773cbca6-4b1a-403a-856e-1f73b28431d3" containerName="istio-proxy"
Oct 30 21:51:38.728307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.728255    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:38.751619 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.751585    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"]
Oct 30 21:51:38.756395 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.756375    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"]
Oct 30 21:51:38.756788 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.756760    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy" containerID="cri-o://1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25" gracePeriod=30
Oct 30 21:51:38.817332 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.816625    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w4-d6e0be\""
Oct 30 21:51:38.843939 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.843891    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"]
Oct 30 21:51:38.873543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.873462    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:38.893207 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.893085    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"]
Oct 30 21:51:38.899688 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.899658    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b21d8ad-3036-412d-a2f6-883f525618e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb\" (UID: \"8b21d8ad-3036-412d-a2f6-883f525618e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:38.899905 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.899884    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw8wp\" (UniqueName: \"kubernetes.io/projected/8b21d8ad-3036-412d-a2f6-883f525618e3-kube-api-access-hw8wp\") pod \"payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb\" (UID: \"8b21d8ad-3036-412d-a2f6-883f525618e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:38.934679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:38.932251    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w4-d6e0be-dockercfg-qncpt\""
Oct 30 21:51:39.001989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.001920    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b21d8ad-3036-412d-a2f6-883f525618e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb\" (UID: \"8b21d8ad-3036-412d-a2f6-883f525618e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:39.002184 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.002003    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw8wp\" (UniqueName: \"kubernetes.io/projected/8b21d8ad-3036-412d-a2f6-883f525618e3-kube-api-access-hw8wp\") pod \"payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb\" (UID: \"8b21d8ad-3036-412d-a2f6-883f525618e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:39.002184 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.002128    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfgcf\" (UniqueName: \"kubernetes.io/projected/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-kube-api-access-tfgcf\") pod \"payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg\" (UID: \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:39.002307 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.002207    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg\" (UID: \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:39.008022 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.003333    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b21d8ad-3036-412d-a2f6-883f525618e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb\" (UID: \"8b21d8ad-3036-412d-a2f6-883f525618e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:39.066807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.066770    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw8wp\" (UniqueName: \"kubernetes.io/projected/8b21d8ad-3036-412d-a2f6-883f525618e3-kube-api-access-hw8wp\") pod \"payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb\" (UID: \"8b21d8ad-3036-412d-a2f6-883f525618e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:39.117146 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.117113    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg\" (UID: \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:39.117716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.117692    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfgcf\" (UniqueName: \"kubernetes.io/projected/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-kube-api-access-tfgcf\") pod \"payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg\" (UID: \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:39.119780 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.119749    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg\" (UID: \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:39.183033 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.182980    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfgcf\" (UniqueName: \"kubernetes.io/projected/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-kube-api-access-tfgcf\") pod \"payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg\" (UID: \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:39.287058 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.287024    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:39.354484 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.354457    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:39.675952 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.675924    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"]
Oct 30 21:51:39.676559 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:51:39.676536    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fe2131_ed20_4602_b74c_6ee6dcf05c77.slice/crio-3c94ddb81a397c72199a044f5734641f420a530c667d59596c43146d211ba76d WatchSource:0}: Error finding container 3c94ddb81a397c72199a044f5734641f420a530c667d59596c43146d211ba76d: Status 404 returned error can't find the container with id 3c94ddb81a397c72199a044f5734641f420a530c667d59596c43146d211ba76d
Oct 30 21:51:39.788837 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:51:39.788808    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b21d8ad_3036_412d_a2f6_883f525618e3.slice/crio-3b69b2fddc23dfc698ec42de680e18a9c890e42be7e191c38ccd399e4d4934d7 WatchSource:0}: Error finding container 3b69b2fddc23dfc698ec42de680e18a9c890e42be7e191c38ccd399e4d4934d7: Status 404 returned error can't find the container with id 3b69b2fddc23dfc698ec42de680e18a9c890e42be7e191c38ccd399e4d4934d7
Oct 30 21:51:39.789459 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.789434    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"]
Oct 30 21:51:39.833630 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:39.833591    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:40.349464 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:40.349428    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb" event={"ID":"8b21d8ad-3036-412d-a2f6-883f525618e3","Type":"ContainerStarted","Data":"281150efd8dc4c9ca7eb00e6f425b61ede70f12915bc3128f5db9c485b0fc361"}
Oct 30 21:51:40.349938 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:40.349496    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:40.349938 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:40.349518    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb" event={"ID":"8b21d8ad-3036-412d-a2f6-883f525618e3","Type":"ContainerStarted","Data":"3b69b2fddc23dfc698ec42de680e18a9c890e42be7e191c38ccd399e4d4934d7"}
Oct 30 21:51:40.351340 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:40.351311    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg" event={"ID":"b1fe2131-ed20-4602-b74c-6ee6dcf05c77","Type":"ContainerStarted","Data":"83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd"}
Oct 30 21:51:40.351482 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:40.351363    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg" event={"ID":"b1fe2131-ed20-4602-b74c-6ee6dcf05c77","Type":"ContainerStarted","Data":"3c94ddb81a397c72199a044f5734641f420a530c667d59596c43146d211ba76d"}
Oct 30 21:51:40.351482 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:40.351388    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:40.468761 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:40.468714    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb" podStartSLOduration=2.46870164 podStartE2EDuration="2.46870164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:40.465441764 +0000 UTC m=+1701.497290298" watchObservedRunningTime="2026-10-30 21:51:40.46870164 +0000 UTC m=+1701.500550174"
Oct 30 21:51:40.588017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:40.586302    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg" podStartSLOduration=2.586269296 podStartE2EDuration="2.586269296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:40.580934502 +0000 UTC m=+1701.612783036" watchObservedRunningTime="2026-10-30 21:51:40.586269296 +0000 UTC m=+1701.618117832"
Oct 30 21:51:41.106465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:41.106432    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:41.268707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:41.268677    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:41.434523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:41.434492    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:43.941448 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.941417    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:51:43.992201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992170    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-data\") pod \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") "
Oct 30 21:51:43.992352 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992216    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-certs\") pod \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") "
Oct 30 21:51:43.992352 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992262    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-podinfo\") pod \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") "
Oct 30 21:51:43.992352 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992321    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-socket\") pod \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") "
Oct 30 21:51:43.992510 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992387    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-credential-socket\") pod \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") "
Oct 30 21:51:43.992510 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992468    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-data" pod "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" (UID: "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:43.992510 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992479    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-certs" pod "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" (UID: "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:43.992670 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992593    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istiod-ca-cert\") pod \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") "
Oct 30 21:51:43.992670 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992656    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-token\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-token\") pod \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") "
Oct 30 21:51:43.993035 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992707    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-envoy\") pod \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") "
Oct 30 21:51:43.993035 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992713    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-socket" pod "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" (UID: "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:43.993035 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992739    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-credential-socket" pod "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" (UID: "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:43.993035 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.992774    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-kube-api-access-j459j\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-kube-api-access-j459j\") pod \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\" (UID: \"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a\") "
Oct 30 21:51:43.993035 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.993022    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istiod-ca-cert" pod "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" (UID: "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:43.993836 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.993809    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:43.994140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.993843    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:43.994140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.993860    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:43.994140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.993874    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:43.994140 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.993889    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:43.995650 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.995297    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-envoy" pod "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" (UID: "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:43.996268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.996238    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-token" pod "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" (UID: "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:43.996370 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.996349    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-podinfo" pod "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" (UID: "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:43.996658 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:43.996621    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-kube-api-access-j459j" pod "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" (UID: "d7bcd6d2-f075-47d4-8353-ed43b6b1f27a"). InnerVolumeSpecName "kube-api-access-j459j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:44.056045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.056020    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:51:44.094404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.094375    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-kube-api-access-gdwpq\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-kube-api-access-gdwpq\") pod \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") "
Oct 30 21:51:44.094570 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.094554    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-token\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-token\") pod \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") "
Oct 30 21:51:44.094667 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.094650    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-credential-socket\") pod \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") "
Oct 30 21:51:44.094735 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.094707    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-socket\") pod \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") "
Oct 30 21:51:44.094808 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.094744    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-podinfo\") pod \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") "
Oct 30 21:51:44.094808 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.094773    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-envoy\") pod \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") "
Oct 30 21:51:44.094908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.094830    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-certs\") pod \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") "
Oct 30 21:51:44.095004 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.094942    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-credential-socket" pod "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" (UID: "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:44.095063 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.094960    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-data\") pod \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") "
Oct 30 21:51:44.095213 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.095095    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istiod-ca-cert\") pod \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\" (UID: \"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a\") "
Oct 30 21:51:44.095213 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.095199    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-data" pod "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" (UID: "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:44.095380 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.095332    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-socket" pod "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" (UID: "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:44.095771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.095696    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-certs" pod "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" (UID: "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:44.096028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.096002    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istiod-ca-cert" pod "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" (UID: "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:44.096203 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.096180    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.096203 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.096210    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j459j\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-kube-api-access-j459j\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.096371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.096227    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.096371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.096242    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.096371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.096257    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.096371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.096270    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.096371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.096284    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.096371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.096298    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.097267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.097238    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-token" pod "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" (UID: "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:44.097469 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.097452    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-kube-api-access-gdwpq" pod "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" (UID: "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a"). InnerVolumeSpecName "kube-api-access-gdwpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:44.097544 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.097494    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-podinfo" pod "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" (UID: "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:44.097953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.097937    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-envoy" pod "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" (UID: "c5416c8b-1d9b-41cb-b721-6430b6b5eb4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:44.198311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.198237    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.198311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.198264    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdwpq\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-kube-api-access-gdwpq\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.198311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.198273    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.198311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.198281    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.198311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.198289    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:44.359696 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.359662    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:44.384952 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.384921    5575 generic.go:356] "Generic (PLEG): container finished" podID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerID="1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25" exitCode=0
Oct 30 21:51:44.385113 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.384983    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"
Oct 30 21:51:44.385113 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.385005    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" event={"ID":"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a","Type":"ContainerDied","Data":"1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25"}
Oct 30 21:51:44.385113 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.385060    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf" event={"ID":"c5416c8b-1d9b-41cb-b721-6430b6b5eb4a","Type":"ContainerDied","Data":"61d7cd0d746b2ad73930edcc5b2548b673596623380e9fcd00ce2e90977ac154"}
Oct 30 21:51:44.385113 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.385087    5575 scope.go:122] "RemoveContainer" containerID="1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25"
Oct 30 21:51:44.386681 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.386654    5575 generic.go:356] "Generic (PLEG): container finished" podID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerID="9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824" exitCode=0
Oct 30 21:51:44.386806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.386716    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"
Oct 30 21:51:44.386806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.386731    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" event={"ID":"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a","Type":"ContainerDied","Data":"9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824"}
Oct 30 21:51:44.386806 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.386780    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2" event={"ID":"d7bcd6d2-f075-47d4-8353-ed43b6b1f27a","Type":"ContainerDied","Data":"40ffe2106980dcc9308d6e9a800c0533884436059f6970b397a1ea677d29c7af"}
Oct 30 21:51:44.398460 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.398443    5575 scope.go:122] "RemoveContainer" containerID="1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25"
Oct 30 21:51:44.398714 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:44.398697    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25\": container with ID starting with 1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25 not found: ID does not exist" containerID="1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25"
Oct 30 21:51:44.398762 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.398720    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25"} err="failed to get container status \"1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25\": rpc error: code = NotFound desc = could not find container \"1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25\": container with ID starting with 1e7400a85705dffe6fb8faf63cbe4c685b34c6d004694211a193e639df261b25 not found: ID does not exist"
Oct 30 21:51:44.398762 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.398737    5575 scope.go:122] "RemoveContainer" containerID="9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824"
Oct 30 21:51:44.411863 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.411843    5575 scope.go:122] "RemoveContainer" containerID="9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824"
Oct 30 21:51:44.412209 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:44.412178    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824\": container with ID starting with 9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824 not found: ID does not exist" containerID="9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824"
Oct 30 21:51:44.412287 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.412218    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824"} err="failed to get container status \"9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824\": rpc error: code = NotFound desc = could not find container \"9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824\": container with ID starting with 9711404f4733605f0cda33455462dd90a8acc79eccade53aa7964eb4ba968824 not found: ID does not exist"
Oct 30 21:51:44.580411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.580283    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:44.600424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.600386    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"]
Oct 30 21:51:44.605383 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.605356    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kfgf2"]
Oct 30 21:51:44.736991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.734622    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"]
Oct 30 21:51:44.747170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.746181    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-4wxpf"]
Oct 30 21:51:44.890383 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.889716    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"]
Oct 30 21:51:44.891802 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.891761    5575 cpu_manager.go:414] "containerMap: removing container" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy"
Oct 30 21:51:44.891959 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.891935    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy"
Oct 30 21:51:44.892096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.892060    5575 cpu_manager.go:414] "containerMap: removing container" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy"
Oct 30 21:51:44.892096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.892072    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy"
Oct 30 21:51:44.892270 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.892255    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" containerName="istio-proxy"
Oct 30 21:51:44.892343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.892278    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" containerName="istio-proxy"
Oct 30 21:51:44.922026 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.904507    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:44.964546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.958409    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"]
Oct 30 21:51:44.964546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.959372    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w1-c92783-dockercfg-pv9dx\""
Oct 30 21:51:44.964546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:44.959441    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w1-c92783\""
Oct 30 21:51:45.046807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.045079    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"]
Oct 30 21:51:45.060438 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.060410    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.080585 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.072037    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fbb4b5-b446-4463-91a5-65a874af96e9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv\" (UID: \"e7fbb4b5-b446-4463-91a5-65a874af96e9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:45.080585 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.072199    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rt2k\" (UniqueName: \"kubernetes.io/projected/e7fbb4b5-b446-4463-91a5-65a874af96e9-kube-api-access-6rt2k\") pod \"payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv\" (UID: \"e7fbb4b5-b446-4463-91a5-65a874af96e9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:45.123591 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.120366    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b8709fb3-serving-cert\""
Oct 30 21:51:45.177872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.177781    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.178229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.178205    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fbb4b5-b446-4463-91a5-65a874af96e9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv\" (UID: \"e7fbb4b5-b446-4463-91a5-65a874af96e9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:45.178415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.178399    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3997709-594e-469a-a373-a89ebd830d46-openshift-service-ca\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.178572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.178557    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rt2k\" (UniqueName: \"kubernetes.io/projected/e7fbb4b5-b446-4463-91a5-65a874af96e9-kube-api-access-6rt2k\") pod \"payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv\" (UID: \"e7fbb4b5-b446-4463-91a5-65a874af96e9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:45.178691 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.178674    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-metrics-certs\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.179331 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.179304    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t78cr\" (UniqueName: \"kubernetes.io/projected/d3997709-594e-469a-a373-a89ebd830d46-kube-api-access-t78cr\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.181953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.179923    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fbb4b5-b446-4463-91a5-65a874af96e9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv\" (UID: \"e7fbb4b5-b446-4463-91a5-65a874af96e9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:45.196236 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.196204    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5416c8b-1d9b-41cb-b721-6430b6b5eb4a" path="/var/lib/kubelet/pods/c5416c8b-1d9b-41cb-b721-6430b6b5eb4a/volumes"
Oct 30 21:51:45.197313 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.197289    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7bcd6d2-f075-47d4-8353-ed43b6b1f27a" path="/var/lib/kubelet/pods/d7bcd6d2-f075-47d4-8353-ed43b6b1f27a/volumes"
Oct 30 21:51:45.202927 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.202906    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"]
Oct 30 21:51:45.256196 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.255660    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rt2k\" (UniqueName: \"kubernetes.io/projected/e7fbb4b5-b446-4463-91a5-65a874af96e9-kube-api-access-6rt2k\") pod \"payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv\" (UID: \"e7fbb4b5-b446-4463-91a5-65a874af96e9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:45.261659 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.261443    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:45.305959 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.305910    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t78cr\" (UniqueName: \"kubernetes.io/projected/d3997709-594e-469a-a373-a89ebd830d46-kube-api-access-t78cr\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.306717 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.306421    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.306872 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:45.306783    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-serving-cert: secret "maas-api-e2e-mt-b8709fb3-serving-cert" not found
Oct 30 21:51:45.306872 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:45.306838    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls podName:d3997709-594e-469a-a373-a89ebd830d46 nodeName:}" failed. No retries permitted until 2026-10-30 21:51:45.806818717 +0000 UTC m=+1706.838667236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls") pod "maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp" (UID: "d3997709-594e-469a-a373-a89ebd830d46") : secret "maas-api-e2e-mt-b8709fb3-serving-cert" not found
Oct 30 21:51:45.308028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.308005    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3997709-594e-469a-a373-a89ebd830d46-openshift-service-ca\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.310620 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.310588    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3997709-594e-469a-a373-a89ebd830d46-openshift-service-ca\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.310788 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.310771    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-metrics-certs\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.313622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.313584    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-metrics-certs\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.372908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.372873    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t78cr\" (UniqueName: \"kubernetes.io/projected/d3997709-594e-469a-a373-a89ebd830d46-kube-api-access-t78cr\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.466317 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.466233    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:45.652989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.652541    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:45.677824 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.677776    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"]
Oct 30 21:51:45.681094 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:51:45.681056    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fbb4b5_b446_4463_91a5_65a874af96e9.slice/crio-3e40e74d284270c9f2df7cbe4a0e8d8128f83efe5a7c72570d0a8a15cc7ca5d0 WatchSource:0}: Error finding container 3e40e74d284270c9f2df7cbe4a0e8d8128f83efe5a7c72570d0a8a15cc7ca5d0: Status 404 returned error can't find the container with id 3e40e74d284270c9f2df7cbe4a0e8d8128f83efe5a7c72570d0a8a15cc7ca5d0
Oct 30 21:51:45.823456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.823416    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.830108 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.830070    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls\") pod \"maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:45.860813 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.860782    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:45.980778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:45.980685    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:46.368411 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:46.368384    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"]
Oct 30 21:51:46.368574 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:51:46.368556    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3997709_594e_469a_a373_a89ebd830d46.slice/crio-e962ee58da682baf59426470e762cfdaf60d26a3bc7ec7c6544a5705ef265c03 WatchSource:0}: Error finding container e962ee58da682baf59426470e762cfdaf60d26a3bc7ec7c6544a5705ef265c03: Status 404 returned error can't find the container with id e962ee58da682baf59426470e762cfdaf60d26a3bc7ec7c6544a5705ef265c03
Oct 30 21:51:46.370130 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:46.370109    5575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:51:46.415240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:46.415204    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv" event={"ID":"e7fbb4b5-b446-4463-91a5-65a874af96e9","Type":"ContainerStarted","Data":"3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a"}
Oct 30 21:51:46.415392 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:46.415272    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:46.415392 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:46.415299    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv" event={"ID":"e7fbb4b5-b446-4463-91a5-65a874af96e9","Type":"ContainerStarted","Data":"3e40e74d284270c9f2df7cbe4a0e8d8128f83efe5a7c72570d0a8a15cc7ca5d0"}
Oct 30 21:51:46.416888 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:46.416865    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp" event={"ID":"d3997709-594e-469a-a373-a89ebd830d46","Type":"ContainerStarted","Data":"e962ee58da682baf59426470e762cfdaf60d26a3bc7ec7c6544a5705ef265c03"}
Oct 30 21:51:46.536903 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:46.536846    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv" podStartSLOduration=2.536832348 podStartE2EDuration="2.536832348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:46.532603147 +0000 UTC m=+1707.564451686" watchObservedRunningTime="2026-10-30 21:51:46.536832348 +0000 UTC m=+1707.568680883"
Oct 30 21:51:48.439562 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:48.439526    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp" event={"ID":"d3997709-594e-469a-a373-a89ebd830d46","Type":"ContainerStarted","Data":"5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163"}
Oct 30 21:51:48.564914 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:48.563785    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp" podStartSLOduration=3.5529297189999998 podStartE2EDuration="4.563764928s" totalImagesPullingTime="1.010835209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:48.560428297 +0000 UTC m=+1709.592276833" watchObservedRunningTime="2026-10-30 21:51:48.563764928 +0000 UTC m=+1709.595613465"
Oct 30 21:51:49.449006 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:49.448953    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:50.040705 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:50.040666    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"]
Oct 30 21:51:50.040996 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:50.040947    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy" containerID="cri-o://857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55" gracePeriod=30
Oct 30 21:51:50.088684 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:50.088648    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"]
Oct 30 21:51:50.088921 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:50.088892    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy" containerID="cri-o://32705a4f4b7b38a2a11dfd916149c926e9b4231736a6eafdfc278b6bf72e20d1" gracePeriod=30
Oct 30 21:51:50.095443 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:50.094779    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"]
Oct 30 21:51:50.095443 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:50.094952    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy" containerID="cri-o://b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2" gracePeriod=30
Oct 30 21:51:50.142428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:50.141209    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"]
Oct 30 21:51:50.142428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:50.141402    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy" containerID="cri-o://1d50d512c46bb9212fc97cb54840802e6022de8edb9fd8fae6aead1de4d8830f" gracePeriod=30
Oct 30 21:51:50.506684 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:50.506652    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:51.012651 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:51.012615    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:51.362894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:51.362812    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:51:51.363273 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:51.363254    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:51:52.769011 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:52.768952    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:51:52.769394 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:52.769040    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:51:53.489268 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:53.489222    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:51:53.744147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:53.743784    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:51:53.744147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:53.743862    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:51:53.858046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:53.858012    5575 patch_prober.go:29] interesting pod/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:51:53.858436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:53.858076    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:51:55.410953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.410929    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:51:55.466661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.466632    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:51:55.500305 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.500272    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:51:55.525475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.525443    5575 generic.go:356] "Generic (PLEG): container finished" podID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerID="32705a4f4b7b38a2a11dfd916149c926e9b4231736a6eafdfc278b6bf72e20d1" exitCode=0
Oct 30 21:51:55.525682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.525569    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" event={"ID":"31d1c316-3569-4d07-b3f4-897ac99c9a79","Type":"ContainerDied","Data":"32705a4f4b7b38a2a11dfd916149c926e9b4231736a6eafdfc278b6bf72e20d1"}
Oct 30 21:51:55.527898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.527869    5575 generic.go:356] "Generic (PLEG): container finished" podID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerID="1d50d512c46bb9212fc97cb54840802e6022de8edb9fd8fae6aead1de4d8830f" exitCode=0
Oct 30 21:51:55.528059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.527942    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" event={"ID":"7bf868ae-27c2-457a-a658-ce5dba1de494","Type":"ContainerDied","Data":"1d50d512c46bb9212fc97cb54840802e6022de8edb9fd8fae6aead1de4d8830f"}
Oct 30 21:51:55.529725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.529702    5575 generic.go:356] "Generic (PLEG): container finished" podID="9d142727-6bbc-44ab-a876-332206529309" containerID="857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55" exitCode=0
Oct 30 21:51:55.529845 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.529758    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"
Oct 30 21:51:55.529928 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.529908    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" event={"ID":"9d142727-6bbc-44ab-a876-332206529309","Type":"ContainerDied","Data":"857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55"}
Oct 30 21:51:55.530762 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.530485    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g" event={"ID":"9d142727-6bbc-44ab-a876-332206529309","Type":"ContainerDied","Data":"0591960f926ccd05ac1e8e778e8bd21db75e71c9ac96be71aa007e2c8c581226"}
Oct 30 21:51:55.530904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.530568    5575 scope.go:122] "RemoveContainer" containerID="857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55"
Oct 30 21:51:55.532698 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.532676    5575 generic.go:356] "Generic (PLEG): container finished" podID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerID="b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2" exitCode=0
Oct 30 21:51:55.532813 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.532752    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" event={"ID":"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50","Type":"ContainerDied","Data":"b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2"}
Oct 30 21:51:55.532813 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.532787    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj" event={"ID":"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50","Type":"ContainerDied","Data":"6d4f39fc4921661a6fb4dc9360fb38ad20a95012d3f968feafbfe89362a9884d"}
Oct 30 21:51:55.532947 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.532861    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"
Oct 30 21:51:55.554675 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.554632    5575 scope.go:122] "RemoveContainer" containerID="857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55"
Oct 30 21:51:55.555693 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:55.555666    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55\": container with ID starting with 857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55 not found: ID does not exist" containerID="857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55"
Oct 30 21:51:55.555837 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.555699    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55"} err="failed to get container status \"857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55\": rpc error: code = NotFound desc = could not find container \"857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55\": container with ID starting with 857e3cd69327fdc87325f2dde3431e2da5de1514c6986c1b339c648ecedbbe55 not found: ID does not exist"
Oct 30 21:51:55.555837 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.555732    5575 scope.go:122] "RemoveContainer" containerID="b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2"
Oct 30 21:51:55.567782 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.567759    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:51:55.568552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.568534    5575 scope.go:122] "RemoveContainer" containerID="1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef"
Oct 30 21:51:55.571832 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.571814    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:51:55.579768 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.579747    5575 scope.go:122] "RemoveContainer" containerID="b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2"
Oct 30 21:51:55.580152 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:55.580128    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2\": container with ID starting with b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2 not found: ID does not exist" containerID="b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2"
Oct 30 21:51:55.580211 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.580159    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2"} err="failed to get container status \"b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2\": rpc error: code = NotFound desc = could not find container \"b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2\": container with ID starting with b2326afb0c6faaecd894187f1943083fa85169782db6b8f4c78b4dd10f31c5f2 not found: ID does not exist"
Oct 30 21:51:55.580211 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.580177    5575 scope.go:122] "RemoveContainer" containerID="1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef"
Oct 30 21:51:55.580419 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:55.580400    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef\": container with ID starting with 1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef not found: ID does not exist" containerID="1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef"
Oct 30 21:51:55.580477 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.580428    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef"} err="failed to get container status \"1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef\": rpc error: code = NotFound desc = could not find container \"1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef\": container with ID starting with 1123e096f48f60b937529bd8234f97a0ca1e26c4e1cba593f4418e3cf7cbe3ef not found: ID does not exist"
Oct 30 21:51:55.583907 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.583882    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-podinfo\") pod \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") "
Oct 30 21:51:55.584066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.583957    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-envoy\") pod \"9d142727-6bbc-44ab-a876-332206529309\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") "
Oct 30 21:51:55.584066 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584007    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-envoy\") pod \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") "
Oct 30 21:51:55.584489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584356    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-socket\") pod \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") "
Oct 30 21:51:55.584489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584425    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istiod-ca-cert\") pod \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") "
Oct 30 21:51:55.584489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584471    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-credential-socket\") pod \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") "
Oct 30 21:51:55.584695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584549    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-credential-socket\") pod \"9d142727-6bbc-44ab-a876-332206529309\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") "
Oct 30 21:51:55.584695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584579    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-data\") pod \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") "
Oct 30 21:51:55.584695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584619    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-socket\") pod \"9d142727-6bbc-44ab-a876-332206529309\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") "
Oct 30 21:51:55.584845 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584784    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-data\") pod \"9d142727-6bbc-44ab-a876-332206529309\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") "
Oct 30 21:51:55.584845 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584825    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-kube-api-access-tgw7b\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-kube-api-access-tgw7b\") pod \"9d142727-6bbc-44ab-a876-332206529309\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") "
Oct 30 21:51:55.584950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584880    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9d142727-6bbc-44ab-a876-332206529309-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d142727-6bbc-44ab-a876-332206529309-istio-podinfo\") pod \"9d142727-6bbc-44ab-a876-332206529309\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") "
Oct 30 21:51:55.584950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.584924    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-token\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-token\") pod \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") "
Oct 30 21:51:55.585098 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.585011    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-certs\") pod \"9d142727-6bbc-44ab-a876-332206529309\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") "
Oct 30 21:51:55.585098 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.585051    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-kube-api-access-qqq5h\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-kube-api-access-qqq5h\") pod \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") "
Oct 30 21:51:55.585098 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.585079    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-istio-token\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-istio-token\") pod \"9d142727-6bbc-44ab-a876-332206529309\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") "
Oct 30 21:51:55.585247 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.585119    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-certs\") pod \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\" (UID: \"641eaa1c-eaf0-4988-a1f2-b8d7f8583a50\") "
Oct 30 21:51:55.585247 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.585174    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d142727-6bbc-44ab-a876-332206529309-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d142727-6bbc-44ab-a876-332206529309-istiod-ca-cert\") pod \"9d142727-6bbc-44ab-a876-332206529309\" (UID: \"9d142727-6bbc-44ab-a876-332206529309\") "
Oct 30 21:51:55.585608 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.585587    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-data" pod "9d142727-6bbc-44ab-a876-332206529309" (UID: "9d142727-6bbc-44ab-a876-332206529309"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.585751 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.585705    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-certs" pod "9d142727-6bbc-44ab-a876-332206529309" (UID: "9d142727-6bbc-44ab-a876-332206529309"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.586205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.586181    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.586331 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.586317    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.586800 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.586776    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-envoy" pod "9d142727-6bbc-44ab-a876-332206529309" (UID: "9d142727-6bbc-44ab-a876-332206529309"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.587036 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.587012    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-credential-socket" pod "9d142727-6bbc-44ab-a876-332206529309" (UID: "9d142727-6bbc-44ab-a876-332206529309"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.587213 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.587189    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-envoy" pod "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" (UID: "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.587213 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.587206    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-socket" pod "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" (UID: "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.587446 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.587402    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-credential-socket" pod "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" (UID: "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.587543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.587522    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-data" pod "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" (UID: "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.587665 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.587573    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istiod-ca-cert" pod "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" (UID: "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:55.587747 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.587611    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-socket" pod "9d142727-6bbc-44ab-a876-332206529309" (UID: "9d142727-6bbc-44ab-a876-332206529309"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.587861 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.587842    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-certs" pod "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" (UID: "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.588452 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.588431    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d142727-6bbc-44ab-a876-332206529309-istiod-ca-cert" pod "9d142727-6bbc-44ab-a876-332206529309" (UID: "9d142727-6bbc-44ab-a876-332206529309"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:55.588567 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.588515    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-kube-api-access-qqq5h" pod "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" (UID: "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50"). InnerVolumeSpecName "kube-api-access-qqq5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:55.589884 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.589859    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-istio-token" pod "9d142727-6bbc-44ab-a876-332206529309" (UID: "9d142727-6bbc-44ab-a876-332206529309"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:55.590341 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.590320    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-kube-api-access-tgw7b" pod "9d142727-6bbc-44ab-a876-332206529309" (UID: "9d142727-6bbc-44ab-a876-332206529309"). InnerVolumeSpecName "kube-api-access-tgw7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:55.590434 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.590375    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d142727-6bbc-44ab-a876-332206529309-istio-podinfo" pod "9d142727-6bbc-44ab-a876-332206529309" (UID: "9d142727-6bbc-44ab-a876-332206529309"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:55.592325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.591430    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-token" pod "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" (UID: "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:55.592325 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.591611    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-podinfo" pod "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" (UID: "641eaa1c-eaf0-4988-a1f2-b8d7f8583a50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:55.687374 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687338    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-credential-socket\") pod \"7bf868ae-27c2-457a-a658-ce5dba1de494\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") "
Oct 30 21:51:55.687552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687401    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-data\") pod \"7bf868ae-27c2-457a-a658-ce5dba1de494\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") "
Oct 30 21:51:55.687552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687444    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-token\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-token\") pod \"7bf868ae-27c2-457a-a658-ce5dba1de494\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") "
Oct 30 21:51:55.687552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687475    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-kube-api-access-r2mtq\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-kube-api-access-r2mtq\") pod \"31d1c316-3569-4d07-b3f4-897ac99c9a79\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") "
Oct 30 21:51:55.687552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687502    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7bf868ae-27c2-457a-a658-ce5dba1de494-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bf868ae-27c2-457a-a658-ce5dba1de494-istiod-ca-cert\") pod \"7bf868ae-27c2-457a-a658-ce5dba1de494\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") "
Oct 30 21:51:55.687552 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687543    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-credential-socket\") pod \"31d1c316-3569-4d07-b3f4-897ac99c9a79\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") "
Oct 30 21:51:55.687829 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687569    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/31d1c316-3569-4d07-b3f4-897ac99c9a79-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d1c316-3569-4d07-b3f4-897ac99c9a79-istiod-ca-cert\") pod \"31d1c316-3569-4d07-b3f4-897ac99c9a79\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") "
Oct 30 21:51:55.687829 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687614    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-podinfo\") pod \"7bf868ae-27c2-457a-a658-ce5dba1de494\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") "
Oct 30 21:51:55.687829 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687634    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-certs\") pod \"7bf868ae-27c2-457a-a658-ce5dba1de494\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") "
Oct 30 21:51:55.687829 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687639    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-credential-socket" pod "7bf868ae-27c2-457a-a658-ce5dba1de494" (UID: "7bf868ae-27c2-457a-a658-ce5dba1de494"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.687829 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687724    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-data" pod "7bf868ae-27c2-457a-a658-ce5dba1de494" (UID: "7bf868ae-27c2-457a-a658-ce5dba1de494"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.687829 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687739    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-certs\") pod \"31d1c316-3569-4d07-b3f4-897ac99c9a79\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") "
Oct 30 21:51:55.688150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687877    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-socket\") pod \"31d1c316-3569-4d07-b3f4-897ac99c9a79\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") "
Oct 30 21:51:55.688150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687933    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-token\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-token\") pod \"31d1c316-3569-4d07-b3f4-897ac99c9a79\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") "
Oct 30 21:51:55.688150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.687957    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-certs" pod "31d1c316-3569-4d07-b3f4-897ac99c9a79" (UID: "31d1c316-3569-4d07-b3f4-897ac99c9a79"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.688150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688026    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-data\") pod \"31d1c316-3569-4d07-b3f4-897ac99c9a79\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") "
Oct 30 21:51:55.688150 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688140    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31d1c316-3569-4d07-b3f4-897ac99c9a79-istiod-ca-cert" pod "31d1c316-3569-4d07-b3f4-897ac99c9a79" (UID: "31d1c316-3569-4d07-b3f4-897ac99c9a79"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:55.688418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688168    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-envoy\") pod \"7bf868ae-27c2-457a-a658-ce5dba1de494\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") "
Oct 30 21:51:55.688418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688197    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-kube-api-access-ph4gq\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-kube-api-access-ph4gq\") pod \"7bf868ae-27c2-457a-a658-ce5dba1de494\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") "
Oct 30 21:51:55.688418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688190    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-certs" pod "7bf868ae-27c2-457a-a658-ce5dba1de494" (UID: "7bf868ae-27c2-457a-a658-ce5dba1de494"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.688418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688268    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-podinfo\") pod \"31d1c316-3569-4d07-b3f4-897ac99c9a79\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") "
Oct 30 21:51:55.688418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688307    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-socket\") pod \"7bf868ae-27c2-457a-a658-ce5dba1de494\" (UID: \"7bf868ae-27c2-457a-a658-ce5dba1de494\") "
Oct 30 21:51:55.688418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688311    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-credential-socket" pod "31d1c316-3569-4d07-b3f4-897ac99c9a79" (UID: "31d1c316-3569-4d07-b3f4-897ac99c9a79"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.688418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688343    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-envoy\") pod \"31d1c316-3569-4d07-b3f4-897ac99c9a79\" (UID: \"31d1c316-3569-4d07-b3f4-897ac99c9a79\") "
Oct 30 21:51:55.688418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688357    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bf868ae-27c2-457a-a658-ce5dba1de494-istiod-ca-cert" pod "7bf868ae-27c2-457a-a658-ce5dba1de494" (UID: "7bf868ae-27c2-457a-a658-ce5dba1de494"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:55.688830 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.688577    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-socket" pod "31d1c316-3569-4d07-b3f4-897ac99c9a79" (UID: "31d1c316-3569-4d07-b3f4-897ac99c9a79"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.689263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689127    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.689263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689153    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.689263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689168    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.689263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689182    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.689263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689195    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.689263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689210    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.689263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689226    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.689263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689242    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.689263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689256    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgw7b\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-kube-api-access-tgw7b\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689271    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d142727-6bbc-44ab-a876-332206529309-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689285    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689299    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689312    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689326    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqq5h\" (UniqueName: \"kubernetes.io/projected/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-kube-api-access-qqq5h\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689340    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d142727-6bbc-44ab-a876-332206529309-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689353    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689365    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bf868ae-27c2-457a-a658-ce5dba1de494-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689379    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d142727-6bbc-44ab-a876-332206529309-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689393    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689407    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689420    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d1c316-3569-4d07-b3f4-897ac99c9a79-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689434    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d142727-6bbc-44ab-a876-332206529309-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689447    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.689460    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.690898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.690628    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-kube-api-access-r2mtq" pod "31d1c316-3569-4d07-b3f4-897ac99c9a79" (UID: "31d1c316-3569-4d07-b3f4-897ac99c9a79"). InnerVolumeSpecName "kube-api-access-r2mtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:55.690898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.690885    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-socket" pod "7bf868ae-27c2-457a-a658-ce5dba1de494" (UID: "7bf868ae-27c2-457a-a658-ce5dba1de494"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.691055 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.691032    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-podinfo" pod "31d1c316-3569-4d07-b3f4-897ac99c9a79" (UID: "31d1c316-3569-4d07-b3f4-897ac99c9a79"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:55.691151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.691127    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-data" pod "31d1c316-3569-4d07-b3f4-897ac99c9a79" (UID: "31d1c316-3569-4d07-b3f4-897ac99c9a79"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.691218 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.691177    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-envoy" pod "31d1c316-3569-4d07-b3f4-897ac99c9a79" (UID: "31d1c316-3569-4d07-b3f4-897ac99c9a79"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.691814 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.691794    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-podinfo" pod "7bf868ae-27c2-457a-a658-ce5dba1de494" (UID: "7bf868ae-27c2-457a-a658-ce5dba1de494"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:55.691879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.691816    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-kube-api-access-ph4gq" pod "7bf868ae-27c2-457a-a658-ce5dba1de494" (UID: "7bf868ae-27c2-457a-a658-ce5dba1de494"). InnerVolumeSpecName "kube-api-access-ph4gq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:55.692379 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.692359    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-token" pod "31d1c316-3569-4d07-b3f4-897ac99c9a79" (UID: "31d1c316-3569-4d07-b3f4-897ac99c9a79"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:55.692721 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.692703    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-token" pod "7bf868ae-27c2-457a-a658-ce5dba1de494" (UID: "7bf868ae-27c2-457a-a658-ce5dba1de494"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:55.693216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.693200    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-envoy" pod "7bf868ae-27c2-457a-a658-ce5dba1de494" (UID: "7bf868ae-27c2-457a-a658-ce5dba1de494"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:55.698612 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.698590    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"]
Oct 30 21:51:55.699347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699331    5575 cpu_manager.go:414] "containerMap: removing container" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy"
Oct 30 21:51:55.699428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699349    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy"
Oct 30 21:51:55.699428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699371    5575 cpu_manager.go:414] "containerMap: removing container" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy"
Oct 30 21:51:55.699428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699378    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy"
Oct 30 21:51:55.699428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699395    5575 cpu_manager.go:414] "containerMap: removing container" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy"
Oct 30 21:51:55.699428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699403    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy"
Oct 30 21:51:55.699682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699445    5575 cpu_manager.go:414] "containerMap: removing container" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy"
Oct 30 21:51:55.699682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699453    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy"
Oct 30 21:51:55.699682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699467    5575 cpu_manager.go:414] "containerMap: removing container" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy"
Oct 30 21:51:55.699682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699473    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy"
Oct 30 21:51:55.699682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699635    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy"
Oct 30 21:51:55.699682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699651    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d142727-6bbc-44ab-a876-332206529309" containerName="istio-proxy"
Oct 30 21:51:55.699682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699664    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" containerName="istio-proxy"
Oct 30 21:51:55.699682 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699680    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" containerName="istio-proxy"
Oct 30 21:51:55.700089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.699690    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" containerName="istio-proxy"
Oct 30 21:51:55.704837 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.704820    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.777016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.761229    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-259e81-serving-cert\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.822535    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.822690    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.822743    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56220335-a914-47a8-ae41-b6ea0652ad67-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.822849    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl8d5\" (UniqueName: \"kubernetes.io/projected/56220335-a914-47a8-ae41-b6ea0652ad67-kube-api-access-tl8d5\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.822980    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.822996    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.823011    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.823024    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.823037    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2mtq\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-kube-api-access-r2mtq\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.823051    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.823065    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.823079    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d1c316-3569-4d07-b3f4-897ac99c9a79-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.823096    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bf868ae-27c2-457a-a658-ce5dba1de494-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.823879 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.823111    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph4gq\" (UniqueName: \"kubernetes.io/projected/7bf868ae-27c2-457a-a658-ce5dba1de494-kube-api-access-ph4gq\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:55.983216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.950266    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.983216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.950342    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56220335-a914-47a8-ae41-b6ea0652ad67-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.983216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.950464    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl8d5\" (UniqueName: \"kubernetes.io/projected/56220335-a914-47a8-ae41-b6ea0652ad67-kube-api-access-tl8d5\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.983216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.950659    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.983216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.952873    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:55.983216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.954355    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56220335-a914-47a8-ae41-b6ea0652ad67-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.983216 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:55.954561    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-serving-cert: secret "maas-api-e2e-shared-a-w2-259e81-serving-cert" not found
Oct 30 21:51:55.983216 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:51:55.954649    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls podName:56220335-a914-47a8-ae41-b6ea0652ad67 nodeName:}" failed. No retries permitted until 2026-10-30 21:51:56.454629116 +0000 UTC m=+1717.486477632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls") pod "maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5" (UID: "56220335-a914-47a8-ae41-b6ea0652ad67") : secret "maas-api-e2e-shared-a-w2-259e81-serving-cert" not found
Oct 30 21:51:55.983216 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.954900    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:55.986245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:55.986097    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"]
Oct 30 21:51:56.039519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.039486    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl8d5\" (UniqueName: \"kubernetes.io/projected/56220335-a914-47a8-ae41-b6ea0652ad67-kube-api-access-tl8d5\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:56.111482 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.111423    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:56.324871 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.324792    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"]
Oct 30 21:51:56.330495 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.330465    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-mbvhj"]
Oct 30 21:51:56.354111 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.354078    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:56.465698 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.465672    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:56.468294 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.468269    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:56.543251 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.543217    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7" event={"ID":"31d1c316-3569-4d07-b3f4-897ac99c9a79","Type":"ContainerDied","Data":"abcd1c0332e1bccbcf8df9161a7092799c13dc2b6bc589968ccfb84e83afe7b8"}
Oct 30 21:51:56.543431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.543295    5575 scope.go:122] "RemoveContainer" containerID="32705a4f4b7b38a2a11dfd916149c926e9b4231736a6eafdfc278b6bf72e20d1"
Oct 30 21:51:56.543431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.543229    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"
Oct 30 21:51:56.545693 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.545670    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"
Oct 30 21:51:56.545825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.545669    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p" event={"ID":"7bf868ae-27c2-457a-a658-ce5dba1de494","Type":"ContainerDied","Data":"b3e3a9afde8a5d039aa1c66306f33fe192049edc1dd09081017322f504632dec"}
Oct 30 21:51:56.557699 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.557676    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"]
Oct 30 21:51:56.559544 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.559524    5575 scope.go:122] "RemoveContainer" containerID="1d50d512c46bb9212fc97cb54840802e6022de8edb9fd8fae6aead1de4d8830f"
Oct 30 21:51:56.562467 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.562446    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-8g52g"]
Oct 30 21:51:56.622315 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.622239    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:56.779117 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.779086    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"]
Oct 30 21:51:56.785957 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.785929    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-7rb5p"]
Oct 30 21:51:56.897679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.897650    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"]
Oct 30 21:51:56.900383 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:56.900361    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-91874e-openshift-default-64b749d677-bkmh7"]
Oct 30 21:51:57.015253 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:57.015224    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"]
Oct 30 21:51:57.015871 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:51:57.015843    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56220335_a914_47a8_ae41_b6ea0652ad67.slice/crio-a7e447b5097c9e595b22dc26511dbe5a25eb001d8f2da7b8779f1c59e5b729f9 WatchSource:0}: Error finding container a7e447b5097c9e595b22dc26511dbe5a25eb001d8f2da7b8779f1c59e5b729f9: Status 404 returned error can't find the container with id a7e447b5097c9e595b22dc26511dbe5a25eb001d8f2da7b8779f1c59e5b729f9
Oct 30 21:51:57.127770 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:57.127744    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31d1c316-3569-4d07-b3f4-897ac99c9a79" path="/var/lib/kubelet/pods/31d1c316-3569-4d07-b3f4-897ac99c9a79/volumes"
Oct 30 21:51:57.128321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:57.128299    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="641eaa1c-eaf0-4988-a1f2-b8d7f8583a50" path="/var/lib/kubelet/pods/641eaa1c-eaf0-4988-a1f2-b8d7f8583a50/volumes"
Oct 30 21:51:57.128976 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:57.128945    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7bf868ae-27c2-457a-a658-ce5dba1de494" path="/var/lib/kubelet/pods/7bf868ae-27c2-457a-a658-ce5dba1de494/volumes"
Oct 30 21:51:57.129697 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:57.129682    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d142727-6bbc-44ab-a876-332206529309" path="/var/lib/kubelet/pods/9d142727-6bbc-44ab-a876-332206529309/volumes"
Oct 30 21:51:57.429925 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:57.429901    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:51:57.562732 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:57.562695    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5" event={"ID":"56220335-a914-47a8-ae41-b6ea0652ad67","Type":"ContainerStarted","Data":"a7e447b5097c9e595b22dc26511dbe5a25eb001d8f2da7b8779f1c59e5b729f9"}
Oct 30 21:51:58.573912 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:58.573877    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5" event={"ID":"56220335-a914-47a8-ae41-b6ea0652ad67","Type":"ContainerStarted","Data":"2cf209da23a2140a06a6369862ad909cbf545e45f6a72112ee13646671ed0437"}
Oct 30 21:51:58.574400 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:58.574179    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:51:58.693865 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:51:58.693807    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5" podStartSLOduration=2.832590567 podStartE2EDuration="3.693788708s" totalImagesPullingTime="861.198141ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:58.691538296 +0000 UTC m=+1719.723386832" watchObservedRunningTime="2026-10-30 21:51:58.693788708 +0000 UTC m=+1719.725637244"
Oct 30 21:52:01.141288 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:01.141200    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:04.588240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:04.588212    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:52:06.047884 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:06.047796    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:10.991049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:10.991009    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:15.864122 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:15.864084    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:20.671635 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:20.671599    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:23.486662 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:52:23.486618    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:52:25.686875 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:25.686839    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:30.391431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:30.391398    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:31.231763 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:31.231721    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:31.436181 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:31.436143    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:31.592365 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:31.592274    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:34.471187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:34.471156    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:34.869260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:34.869165    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:36.812147 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:36.812111    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:37.993299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:37.993270    5575 generic.go:356] "Generic (PLEG): container finished" podID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerID="e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922" exitCode=0
Oct 30 21:52:37.993637 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:37.993330    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" event={"ID":"fa9b9295-3acd-4cb9-8d87-32560888e3cf","Type":"ContainerDied","Data":"e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922"}
Oct 30 21:52:37.993776 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:37.993759    5575 scope.go:122] "RemoveContainer" containerID="e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922"
Oct 30 21:52:37.995318 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:37.995294    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:52:37.995391 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:37.995361    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:52:37.995430 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:37.995390    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:52:39.003506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:39.003472    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" event={"ID":"fa9b9295-3acd-4cb9-8d87-32560888e3cf","Type":"ContainerStarted","Data":"bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966"}
Oct 30 21:52:39.399263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:39.399233    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:52:39.399424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:39.399356    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:52:39.399424 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:39.399409    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:52:40.399492 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:40.399449    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:52:40.399921 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:40.399510    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:52:41.399535 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:41.399497    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:52:41.399989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:41.399552    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:52:41.658373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:41.658296    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:41.851429 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:41.851397    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:42.016115 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:42.013246    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:42.399104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:42.399068    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:52:42.399274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:42.399123    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:52:43.399085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:43.399049    5575 patch_prober.go:29] interesting pod/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:52:43.399470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:43.399108    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:52:44.403571 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:44.403540    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:52:44.404114 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:44.403921    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:52:44.404754 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:44.404730    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:52:45.714899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:45.714862    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:46.941361 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:46.941325    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:50.855496 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:50.855430    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:51.876560 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:51.876515    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:52.032757 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:52.032720    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:52.188037 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:52.188006    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:53.596487 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:52:53.596451    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:52:56.865566 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:56.865533    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:57.290298 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:57.290240    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:57.633054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:57.633021    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:58.147013 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:52:58.146942    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:02.444725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:02.444617    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:02.623281 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:02.623244    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:02.801417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:02.801309    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:05.747274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:05.747240    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:05.971701 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:05.971666    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:08.240783 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:08.240747    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:13.509078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:13.509048    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:17.690218 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:17.690182    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:18.605612 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:18.605573    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:18.775574 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:18.775537    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:19.271109 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:19.271071    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:19.491416 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:19.491390    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:53:19.492803 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:19.492778    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:53:19.506625 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:19.506604    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:53:19.507713 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:19.507690    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:53:23.516183 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:23.514798    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:23.518243 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:53:23.518210    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:53:24.132680 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:24.132636    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:24.334353 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:24.334306    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:25.698186 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:25.698146    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:29.368245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:29.368162    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:34.387151 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.387113    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:34.609205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.609172    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"]
Oct 30 21:53:34.615015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.613144    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.664622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.664522    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-token\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.664622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.664612    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-certs\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.664873 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.664642    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-envoy\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.664873 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.664682    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-credential-socket\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.664873 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.664714    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w2f8\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-kube-api-access-4w2f8\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.664873 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.664802    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istiod-ca-cert\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.665162 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.665140    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-data\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.665215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.665205    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-podinfo\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.665326 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.665300    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-socket\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.667322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.667087    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-bd3c59-openshift-default-dockercfg-gmrd4\""
Oct 30 21:53:34.754723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.754635    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"]
Oct 30 21:53:34.775015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.774316    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-certs\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.775015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.774378    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-envoy\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.775015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.774413    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-credential-socket\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.775015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.774448    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w2f8\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-kube-api-access-4w2f8\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.775015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.774554    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istiod-ca-cert\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.775015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.774698    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-data\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.775015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.774766    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-podinfo\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.775015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.774813    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-socket\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.775015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.774899    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-token\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.776741 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.776398    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-certs\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.777645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.777525    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istiod-ca-cert\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.778056 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.778037    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-credential-socket\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.779053 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.779013    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-data\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.779512 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.779491    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-socket\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.782547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.782508    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-podinfo\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.785006 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.784953    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-envoy\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.802564 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.802463    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:34.854750 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.854683    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w2f8\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-kube-api-access-4w2f8\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.869845 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.869750    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-token\") pod \"e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") " pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:34.953121 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:34.939629    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:35.451442 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:35.451413    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"]
Oct 30 21:53:35.460815 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:35.459692    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:53:35.460815 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:35.459788    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:53:35.460815 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:35.459827    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:53:35.582040 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:35.582005    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" event={"ID":"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40","Type":"ContainerStarted","Data":"f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4"}
Oct 30 21:53:35.582185 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:35.582063    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" event={"ID":"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40","Type":"ContainerStarted","Data":"6d3c83d6178b2260106bab72a110882a0126e6220b1589a05fcf4a9a41fa7814"}
Oct 30 21:53:35.627342 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:35.627313    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:35.713601 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:35.713502    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" podStartSLOduration=1.713484003 podStartE2EDuration="1.713484003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:35.709439619 +0000 UTC m=+1816.741288155" watchObservedRunningTime="2026-10-30 21:53:35.713484003 +0000 UTC m=+1816.745332539"
Oct 30 21:53:35.940791 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:35.940759    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:36.946368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:36.946337    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:37.597072 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:37.597032    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:37.598297 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:37.598277    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:53:37.935160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:37.935110    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:38.842030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:38.841921    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:39.039639 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:39.039605    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:39.271754 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:39.271697    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:40.153431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:40.153393    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:42.243556 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:42.243489    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:42.454537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:42.454496    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:45.547302 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:45.547270    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:50.594506 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:50.594470    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:51.202619 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:51.202587    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:51.373700 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:51.373663    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:53.487414 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:53:53.487378    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:53:55.757277 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:55.757202    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:59.970598 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:53:59.970565    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:01.164718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:01.164668    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:01.708673 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:01.708600    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:02.384981 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:02.384880    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:02.904142 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:02.904101    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:06.084720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:06.084686    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:06.287001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:06.286434    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:06.480061 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:06.480026    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:07.251608 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:07.251572    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:10.452914 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:10.452876    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:10.642584 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:10.642537    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:12.796954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:12.796909    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:15.876241 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:15.876202    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:17.891278 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:17.891241    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:19.443618 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:19.443576    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:19.896485 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:19.896457    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:20.615989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.610029    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"]
Oct 30 21:54:20.631428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.631398    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.696674 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.696354    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:20.702666 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.702634    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"]
Oct 30 21:54:20.747989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.741993    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-5bfa09-openshift-default-dockercfg-jl9rm\""
Oct 30 21:54:20.752076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.749243    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-certs\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.752076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.751152    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a176d0-0829-498e-9570-ad1624881eec-istiod-ca-cert\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.752076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.751224    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-socket\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.752076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.751293    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-data\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.752076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.751382    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm5wk\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-kube-api-access-zm5wk\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.752076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.751455    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-envoy\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.752076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.751489    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-istio-token\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.752076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.751577    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a176d0-0829-498e-9570-ad1624881eec-istio-podinfo\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.752076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.751617    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-credential-socket\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.852920 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.852879    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a176d0-0829-498e-9570-ad1624881eec-istio-podinfo\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.853727 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.853702    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-credential-socket\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.856290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.854282    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-credential-socket\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.856524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.856461    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a176d0-0829-498e-9570-ad1624881eec-istio-podinfo\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.856716 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.856564    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-certs\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.856884 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.856861    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-certs\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.857064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.857042    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a176d0-0829-498e-9570-ad1624881eec-istiod-ca-cert\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.858087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.857955    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a176d0-0829-498e-9570-ad1624881eec-istiod-ca-cert\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.858270 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.858234    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-socket\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.858400 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.858316    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-data\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.858466 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.858405    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm5wk\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-kube-api-access-zm5wk\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.858524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.858477    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-envoy\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.858524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.858510    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-istio-token\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.859165 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.859133    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-socket\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.859378 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.859360    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-data\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.862539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.862507    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-envoy\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.920203 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.920175    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-istio-token\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:20.920471 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:20.920435    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm5wk\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-kube-api-access-zm5wk\") pod \"e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") " pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:21.023650 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:21.023619    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:21.149287 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:21.126581    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:21.469226 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:54:21.469197    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a176d0_0829_498e_9570_ad1624881eec.slice/crio-b2fb672f87791afbc48b86b7109c09f741192e47ec96ce982e8240c3b71ba37d WatchSource:0}: Error finding container b2fb672f87791afbc48b86b7109c09f741192e47ec96ce982e8240c3b71ba37d: Status 404 returned error can't find the container with id b2fb672f87791afbc48b86b7109c09f741192e47ec96ce982e8240c3b71ba37d
Oct 30 21:54:21.470470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:21.470445    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"]
Oct 30 21:54:21.471720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:21.471688    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:54:21.471800 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:21.471751    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:54:21.471800 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:21.471781    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:54:22.011475 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:22.011444    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" event={"ID":"c7a176d0-0829-498e-9570-ad1624881eec","Type":"ContainerStarted","Data":"5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c"}
Oct 30 21:54:22.011951 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:22.011496    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" event={"ID":"c7a176d0-0829-498e-9570-ad1624881eec","Type":"ContainerStarted","Data":"b2fb672f87791afbc48b86b7109c09f741192e47ec96ce982e8240c3b71ba37d"}
Oct 30 21:54:22.023743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:22.023717    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:22.031305 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:22.031283    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:22.133790 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:22.133738    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" podStartSLOduration=2.133724376 podStartE2EDuration="2.133724376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:22.13252657 +0000 UTC m=+1863.164375107" watchObservedRunningTime="2026-10-30 21:54:22.133724376 +0000 UTC m=+1863.165572910"
Oct 30 21:54:22.244549 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:22.244509    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:22.704693 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:22.704660    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:23.023191 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:23.023021    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:23.024049 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:23.024027    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:54:23.337862 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:23.337772    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:23.564994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:23.561947    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:23.595990 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:54:23.595872    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:54:23.740795 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:23.740755    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:24.065208 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:24.065177    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:24.236249 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:24.236218    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:25.156346 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:25.156280    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:25.325523 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:25.325493    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:25.508321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:25.508234    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:28.421337 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:28.421304    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:28.621367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:28.616795    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:29.063987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:29.059546    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:34.399948 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:34.399898    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.286793 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:38.286726    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.520222 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:38.520179    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:39.589318 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:39.589277    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:41.557730 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:41.557675    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:41.782520 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:41.782483    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:45.176249 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:45.176217    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:46.935460 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:46.935426    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:48.036580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:48.036542    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:50.059154 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:50.059120    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:51.585191 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:51.585157    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:53.487932 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:54:53.487896    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:54:55.470321 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:54:55.470284    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:00.624279 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:00.624184    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:02.727215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:02.727168    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:02.903284 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:02.903227    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:05.318946 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.318915    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"]
Oct 30 21:55:05.323704 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.323684    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.392720 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.392685    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.393089 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.393063    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.393210 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.393137    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j569\" (UniqueName: \"kubernetes.io/projected/b38533f7-6287-49e6-a2fb-bb2a26e693d4-kube-api-access-7j569\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.393326 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.393301    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38533f7-6287-49e6-a2fb-bb2a26e693d4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.427868 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.427840    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-bd3c59-serving-cert\""
Oct 30 21:55:05.432279 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.432257    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"]
Oct 30 21:55:05.494655 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.494624    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.494825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.494704    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j569\" (UniqueName: \"kubernetes.io/projected/b38533f7-6287-49e6-a2fb-bb2a26e693d4-kube-api-access-7j569\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.494825 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:55:05.494796    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-serving-cert: secret "maas-api-e2e-shared-b-w2-bd3c59-serving-cert" not found
Oct 30 21:55:05.494825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.494813    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38533f7-6287-49e6-a2fb-bb2a26e693d4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.495006 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:55:05.494870    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls podName:b38533f7-6287-49e6-a2fb-bb2a26e693d4 nodeName:}" failed. No retries permitted until 2026-10-30 21:55:05.994848834 +0000 UTC m=+1907.026697350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls") pod "maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr" (UID: "b38533f7-6287-49e6-a2fb-bb2a26e693d4") : secret "maas-api-e2e-shared-b-w2-bd3c59-serving-cert" not found
Oct 30 21:55:05.495006 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.494946    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.495582 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.495541    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38533f7-6287-49e6-a2fb-bb2a26e693d4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.497773 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.497745    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.521914 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.521883    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:05.555913 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.555887    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j569\" (UniqueName: \"kubernetes.io/projected/b38533f7-6287-49e6-a2fb-bb2a26e693d4-kube-api-access-7j569\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:05.684465 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.684435    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:05.927093 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:05.927050    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:06.012301 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:06.012230    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:06.014867 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:06.014841    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:06.240232 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:06.240200    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:06.629693 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:55:06.629658    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38533f7_6287_49e6_a2fb_bb2a26e693d4.slice/crio-04c758f3f2050d1c9b3e4a6c40d445217621333c321ea05426e1f29d1162d009 WatchSource:0}: Error finding container 04c758f3f2050d1c9b3e4a6c40d445217621333c321ea05426e1f29d1162d009: Status 404 returned error can't find the container with id 04c758f3f2050d1c9b3e4a6c40d445217621333c321ea05426e1f29d1162d009
Oct 30 21:55:06.633119 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:06.633095    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"]
Oct 30 21:55:07.485143 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:07.485095    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr" event={"ID":"b38533f7-6287-49e6-a2fb-bb2a26e693d4","Type":"ContainerStarted","Data":"04c758f3f2050d1c9b3e4a6c40d445217621333c321ea05426e1f29d1162d009"}
Oct 30 21:55:08.502677 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:08.502635    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr" event={"ID":"b38533f7-6287-49e6-a2fb-bb2a26e693d4","Type":"ContainerStarted","Data":"cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb"}
Oct 30 21:55:08.503200 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:08.502748    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:08.622608 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:08.622553    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr" podStartSLOduration=2.833338759 podStartE2EDuration="3.622538752s" totalImagesPullingTime="789.199993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:55:08.620781291 +0000 UTC m=+1909.652629827" watchObservedRunningTime="2026-10-30 21:55:08.622538752 +0000 UTC m=+1909.654387287"
Oct 30 21:55:10.617072 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:10.617040    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:14.516104 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:14.516065    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:55:15.667903 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:15.667846    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:20.589430 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:20.589388    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:23.488610 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:55:23.488563    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:55:25.585305 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:25.585256    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:30.695008 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:30.694932    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:35.763177 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:35.763145    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:36.091688 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:36.091609    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:41.024824 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:41.024782    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:46.061143 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:46.061108    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:51.128279 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:51.128247    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:51.916745 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:51.916684    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:53.489095 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:55:53.489059    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:55:56.272144 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:56.272113    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:56.473282 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:56.473215    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:56.646550 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:55:56.646511    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:01.084038 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:01.084000    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"]
Oct 30 21:56:01.185909 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:01.185871    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"]
Oct 30 21:56:01.497001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:01.489894    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:01.687541 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:01.687490    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:01.859628 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:01.859522    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:06.084595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:06.084550    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf" podUID="af55c619-d523-465c-8ee5-1de76ad781ac" containerName="payload-processing" containerID="cri-o://83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6" gracePeriod=25
Oct 30 21:56:06.186957 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:06.186904    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq" podUID="ca17539c-7cf8-48bf-b168-a20d208aae98" containerName="payload-pre-processing" containerID="cri-o://7157c2bb2f8123412c628c16118f539abdb74f708adf1667189f5371edfcd52b" gracePeriod=25
Oct 30 21:56:06.385920 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:06.385882    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"]
Oct 30 21:56:06.386433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:06.386396    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp" podUID="d3997709-594e-469a-a373-a89ebd830d46" containerName="maas-api" containerID="cri-o://5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163" gracePeriod=30
Oct 30 21:56:06.566647 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:06.565868    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:07.161722 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.161690    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:56:07.203864 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.203837    5575 generic.go:356] "Generic (PLEG): container finished" podID="d3997709-594e-469a-a373-a89ebd830d46" containerID="5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163" exitCode=0
Oct 30 21:56:07.204023 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.203880    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"
Oct 30 21:56:07.204023 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.203920    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp" event={"ID":"d3997709-594e-469a-a373-a89ebd830d46","Type":"ContainerDied","Data":"5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163"}
Oct 30 21:56:07.204023 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.204000    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp" event={"ID":"d3997709-594e-469a-a373-a89ebd830d46","Type":"ContainerDied","Data":"e962ee58da682baf59426470e762cfdaf60d26a3bc7ec7c6544a5705ef265c03"}
Oct 30 21:56:07.204139 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.204024    5575 scope.go:122] "RemoveContainer" containerID="5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163"
Oct 30 21:56:07.250983 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.250938    5575 scope.go:122] "RemoveContainer" containerID="5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163"
Oct 30 21:56:07.251384 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.251359    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls\") pod \"d3997709-594e-469a-a373-a89ebd830d46\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") "
Oct 30 21:56:07.251502 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.251485    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d3997709-594e-469a-a373-a89ebd830d46-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3997709-594e-469a-a373-a89ebd830d46-openshift-service-ca\") pod \"d3997709-594e-469a-a373-a89ebd830d46\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") "
Oct 30 21:56:07.251621 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.251605    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3997709-594e-469a-a373-a89ebd830d46-kube-api-access-t78cr\" (UniqueName: \"kubernetes.io/projected/d3997709-594e-469a-a373-a89ebd830d46-kube-api-access-t78cr\") pod \"d3997709-594e-469a-a373-a89ebd830d46\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") "
Oct 30 21:56:07.251689 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:56:07.251367    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163\": container with ID starting with 5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163 not found: ID does not exist" containerID="5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163"
Oct 30 21:56:07.251803 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.251786    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-metrics-certs\") pod \"d3997709-594e-469a-a373-a89ebd830d46\" (UID: \"d3997709-594e-469a-a373-a89ebd830d46\") "
Oct 30 21:56:07.251891 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.251805    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3997709-594e-469a-a373-a89ebd830d46-openshift-service-ca" pod "d3997709-594e-469a-a373-a89ebd830d46" (UID: "d3997709-594e-469a-a373-a89ebd830d46"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:56:07.252145 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.252115    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163"} err="failed to get container status \"5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163\": rpc error: code = NotFound desc = could not find container \"5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163\": container with ID starting with 5bede3c5763acada20b7d0fda65a297d9265a82fcde54c672a7f52de1192e163 not found: ID does not exist"
Oct 30 21:56:07.252748 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.252433    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3997709-594e-469a-a373-a89ebd830d46-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:07.254787 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.254758    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls" pod "d3997709-594e-469a-a373-a89ebd830d46" (UID: "d3997709-594e-469a-a373-a89ebd830d46"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:07.254890 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.254816    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3997709-594e-469a-a373-a89ebd830d46-kube-api-access-t78cr" pod "d3997709-594e-469a-a373-a89ebd830d46" (UID: "d3997709-594e-469a-a373-a89ebd830d46"). InnerVolumeSpecName "kube-api-access-t78cr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:07.259778 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.259755    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-metrics-certs" pod "d3997709-594e-469a-a373-a89ebd830d46" (UID: "d3997709-594e-469a-a373-a89ebd830d46"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:07.353904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.353863    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t78cr\" (UniqueName: \"kubernetes.io/projected/d3997709-594e-469a-a373-a89ebd830d46-kube-api-access-t78cr\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:07.353904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.353899    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:07.353904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.353912    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3997709-594e-469a-a373-a89ebd830d46-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:07.666535 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.666501    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"]
Oct 30 21:56:07.675079 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:07.675051    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b8709fb3-8575c8c599-8fshp"]
Oct 30 21:56:08.098980 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:08.098930    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:08.338294 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:08.338259    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:08.494721 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:08.494676    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:09.129076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:09.129044    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d3997709-594e-469a-a373-a89ebd830d46" path="/var/lib/kubelet/pods/d3997709-594e-469a-a373-a89ebd830d46/volumes"
Oct 30 21:56:09.179179 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:09.179150    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:12.282311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:12.282283    5575 generic.go:356] "Generic (PLEG): container finished" podID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerID="f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4" exitCode=0
Oct 30 21:56:12.282760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:12.282365    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" event={"ID":"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40","Type":"ContainerDied","Data":"f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4"}
Oct 30 21:56:12.282872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:12.282853    5575 scope.go:122] "RemoveContainer" containerID="f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4"
Oct 30 21:56:12.284655 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:12.284627    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:12.284735 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:12.284706    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:12.284780 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:12.284740    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:13.293613 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:13.293577    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" event={"ID":"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40","Type":"ContainerStarted","Data":"b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d"}
Oct 30 21:56:13.540601 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:13.540563    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:13.728990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:13.723909    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:13.878440 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:13.878233    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:13.940903 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:13.940873    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:56:13.941237 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:13.941015    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:56:13.941344 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:13.941295    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 21:56:14.940417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:14.940375    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:56:14.940906 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:14.940454    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 21:56:15.004048 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:15.004015    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq" podUID="ca17539c-7cf8-48bf-b168-a20d208aae98" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:56:15.004220 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:15.004056    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf" podUID="af55c619-d523-465c-8ee5-1de76ad781ac" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:56:15.940949 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:15.940917    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:56:15.941350 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:15.941002    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 21:56:16.941170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:16.941135    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:56:16.941571 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:16.941188    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 21:56:17.553218 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:17.553183    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:17.731029 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:17.724468    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:17.935014 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:17.934919    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:17.940828 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:17.940807    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:56:17.941014 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:17.940994    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 21:56:18.407798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:18.407713    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:18.577590 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:18.577548    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:18.856500 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:18.856412    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:18.946796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:18.946762    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:56:18.947322 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:18.947293    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:56:18.948262 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:18.948234    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 21:56:23.490893 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:56:23.490859    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:56:23.806086 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:23.799673    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:24.897284 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:24.897243    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:25.003661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:25.003619    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf" podUID="af55c619-d523-465c-8ee5-1de76ad781ac" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:56:25.003661 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:25.003637    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq" podUID="ca17539c-7cf8-48bf-b168-a20d208aae98" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:56:25.071511 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:25.071477    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:26.387840 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.387815    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:56:26.449821 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.449726    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af55c619-d523-465c-8ee5-1de76ad781ac-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af55c619-d523-465c-8ee5-1de76ad781ac-plugins-config-volume\") pod \"af55c619-d523-465c-8ee5-1de76ad781ac\" (UID: \"af55c619-d523-465c-8ee5-1de76ad781ac\") "
Oct 30 21:56:26.450014 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.449926    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af55c619-d523-465c-8ee5-1de76ad781ac-kube-api-access-ffvnf\" (UniqueName: \"kubernetes.io/projected/af55c619-d523-465c-8ee5-1de76ad781ac-kube-api-access-ffvnf\") pod \"af55c619-d523-465c-8ee5-1de76ad781ac\" (UID: \"af55c619-d523-465c-8ee5-1de76ad781ac\") "
Oct 30 21:56:26.450729 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.450692    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af55c619-d523-465c-8ee5-1de76ad781ac-plugins-config-volume" pod "af55c619-d523-465c-8ee5-1de76ad781ac" (UID: "af55c619-d523-465c-8ee5-1de76ad781ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:56:26.451304 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.451284    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af55c619-d523-465c-8ee5-1de76ad781ac-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.457702 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.457668    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af55c619-d523-465c-8ee5-1de76ad781ac-kube-api-access-ffvnf" pod "af55c619-d523-465c-8ee5-1de76ad781ac" (UID: "af55c619-d523-465c-8ee5-1de76ad781ac"). InnerVolumeSpecName "kube-api-access-ffvnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:26.467929 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.467905    5575 generic.go:356] "Generic (PLEG): container finished" podID="ca17539c-7cf8-48bf-b168-a20d208aae98" containerID="7157c2bb2f8123412c628c16118f539abdb74f708adf1667189f5371edfcd52b" exitCode=0
Oct 30 21:56:26.468044 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.467992    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq" event={"ID":"ca17539c-7cf8-48bf-b168-a20d208aae98","Type":"ContainerDied","Data":"7157c2bb2f8123412c628c16118f539abdb74f708adf1667189f5371edfcd52b"}
Oct 30 21:56:26.469798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.469773    5575 generic.go:356] "Generic (PLEG): container finished" podID="af55c619-d523-465c-8ee5-1de76ad781ac" containerID="83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6" exitCode=0
Oct 30 21:56:26.469908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.469866    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf" event={"ID":"af55c619-d523-465c-8ee5-1de76ad781ac","Type":"ContainerDied","Data":"83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6"}
Oct 30 21:56:26.470009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.469915    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf" event={"ID":"af55c619-d523-465c-8ee5-1de76ad781ac","Type":"ContainerDied","Data":"39933ff8a806e872ed5cab046f561a346c907760e6e99b83a1eeea421537e109"}
Oct 30 21:56:26.470009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.469942    5575 scope.go:122] "RemoveContainer" containerID="83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6"
Oct 30 21:56:26.470179 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.470161    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"
Oct 30 21:56:26.495405 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.495067    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:56:26.499373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.499355    5575 scope.go:122] "RemoveContainer" containerID="83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6"
Oct 30 21:56:26.499640 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:56:26.499615    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6\": container with ID starting with 83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6 not found: ID does not exist" containerID="83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6"
Oct 30 21:56:26.499715 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.499651    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6"} err="failed to get container status \"83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6\": rpc error: code = NotFound desc = could not find container \"83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6\": container with ID starting with 83cb854f1f8e96fd2ef7cb7659167073262cb7910dd35c6ac416d7b9ec6e0ec6 not found: ID does not exist"
Oct 30 21:56:26.552771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.552738    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca17539c-7cf8-48bf-b168-a20d208aae98-kube-api-access-rl4ns\" (UniqueName: \"kubernetes.io/projected/ca17539c-7cf8-48bf-b168-a20d208aae98-kube-api-access-rl4ns\") pod \"ca17539c-7cf8-48bf-b168-a20d208aae98\" (UID: \"ca17539c-7cf8-48bf-b168-a20d208aae98\") "
Oct 30 21:56:26.553015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.552995    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca17539c-7cf8-48bf-b168-a20d208aae98-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca17539c-7cf8-48bf-b168-a20d208aae98-plugins-config-volume\") pod \"ca17539c-7cf8-48bf-b168-a20d208aae98\" (UID: \"ca17539c-7cf8-48bf-b168-a20d208aae98\") "
Oct 30 21:56:26.553452 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.553426    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca17539c-7cf8-48bf-b168-a20d208aae98-plugins-config-volume" pod "ca17539c-7cf8-48bf-b168-a20d208aae98" (UID: "ca17539c-7cf8-48bf-b168-a20d208aae98"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:56:26.553724 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.553706    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffvnf\" (UniqueName: \"kubernetes.io/projected/af55c619-d523-465c-8ee5-1de76ad781ac-kube-api-access-ffvnf\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.554028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.554011    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca17539c-7cf8-48bf-b168-a20d208aae98-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.555732 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.555708    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca17539c-7cf8-48bf-b168-a20d208aae98-kube-api-access-rl4ns" pod "ca17539c-7cf8-48bf-b168-a20d208aae98" (UID: "ca17539c-7cf8-48bf-b168-a20d208aae98"). InnerVolumeSpecName "kube-api-access-rl4ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:26.656212 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.656174    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl4ns\" (UniqueName: \"kubernetes.io/projected/ca17539c-7cf8-48bf-b168-a20d208aae98-kube-api-access-rl4ns\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.745681 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.745634    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"]
Oct 30 21:56:26.751221 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:26.751199    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-5v5bf"]
Oct 30 21:56:27.130360 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:27.130328    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af55c619-d523-465c-8ee5-1de76ad781ac" path="/var/lib/kubelet/pods/af55c619-d523-465c-8ee5-1de76ad781ac/volumes"
Oct 30 21:56:27.479396 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:27.479371    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"
Oct 30 21:56:27.479893 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:27.479410    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq" event={"ID":"ca17539c-7cf8-48bf-b168-a20d208aae98","Type":"ContainerDied","Data":"933744f99f53167c68284f726b6c1c8105fb39a101012ecccf729136e8bf4ef6"}
Oct 30 21:56:27.479893 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:27.479476    5575 scope.go:122] "RemoveContainer" containerID="7157c2bb2f8123412c628c16118f539abdb74f708adf1667189f5371edfcd52b"
Oct 30 21:56:27.651612 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:27.651579    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"]
Oct 30 21:56:27.701656 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:27.701624    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-qtqtq"]
Oct 30 21:56:28.818760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:28.818723    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:29.130633 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:29.130510    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:29.135622 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:29.135590    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca17539c-7cf8-48bf-b168-a20d208aae98" path="/var/lib/kubelet/pods/ca17539c-7cf8-48bf-b168-a20d208aae98/volumes"
Oct 30 21:56:30.532559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:30.532520    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:30.693980 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:30.693937    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:33.852428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:33.852387    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:35.337633 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:35.337584    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:35.505136 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:35.505106    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:38.926365 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:38.926334    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:44.569209 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:44.569136    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:44.633276 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:44.633240    5575 generic.go:356] "Generic (PLEG): container finished" podID="c7a176d0-0829-498e-9570-ad1624881eec" containerID="5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c" exitCode=0
Oct 30 21:56:44.633276 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:44.633274    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" event={"ID":"c7a176d0-0829-498e-9570-ad1624881eec","Type":"ContainerDied","Data":"5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c"}
Oct 30 21:56:44.633728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:44.633710    5575 scope.go:122] "RemoveContainer" containerID="5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c"
Oct 30 21:56:44.635436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:44.635409    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:44.635543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:44.635472    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:44.635543 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:44.635504    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:45.653741 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:45.653711    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" event={"ID":"c7a176d0-0829-498e-9570-ad1624881eec","Type":"ContainerStarted","Data":"216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e"}
Oct 30 21:56:46.024397 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:46.024309    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:56:46.024731 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:46.024702    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 21:56:46.024904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:46.024880    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 21:56:47.027373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:47.027334    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 21:56:47.028003 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:47.027945    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 21:56:48.028992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:48.028343    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 21:56:48.028992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:48.028418    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 21:56:48.626316 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:48.626277    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:49.026415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:49.026375    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 21:56:49.026792 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:49.026760    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 21:56:49.964261 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:49.964225    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:50.039994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:50.034100    5575 patch_prober.go:29] interesting pod/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 21:56:50.039994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:50.034188    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 21:56:51.047770 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:51.047740    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:56:51.048308 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:51.048266    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:56:51.049082 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:51.049058    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 21:56:52.120438 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:52.120403    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:52.276010 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:52.275905    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:52.451240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:52.451208    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:53.537648 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:56:53.537609    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:56:54.913390 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:54.913336    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:55.184038 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:55.183889    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:56.180752 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:56.180718    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"]
Oct 30 21:56:56.181208 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:56.180914    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy" containerID="cri-o://790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b" gracePeriod=30
Oct 30 21:56:56.233076 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:56.233043    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"]
Oct 30 21:56:56.233313 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:56.233287    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy" containerID="cri-o://35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea" gracePeriod=30
Oct 30 21:56:56.352155 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:56.352119    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"]
Oct 30 21:56:56.352355 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:56.352331    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy" containerID="cri-o://426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872" gracePeriod=30
Oct 30 21:56:57.374652 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:57.374616    5575 patch_prober.go:29] interesting pod/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:56:57.375132 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:57.374684    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:56:59.130539 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:59.130512    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"]
Oct 30 21:56:59.131001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:56:59.130684    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy" containerID="cri-o://96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64" gracePeriod=30
Oct 30 21:57:00.063922 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:00.063887    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:00.926357 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:00.926321    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:57:00.926741 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:00.926395    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:57:01.539357 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.539325    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:57:01.582229 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.582204    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:57:01.628564 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.628541    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:57:01.656916 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.656891    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-socket\") pod \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") "
Oct 30 21:57:01.657070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.656948    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-podinfo\") pod \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") "
Oct 30 21:57:01.657070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657068    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-credential-socket\") pod \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") "
Oct 30 21:57:01.657182 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657107    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-data\") pod \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") "
Oct 30 21:57:01.657226 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657191    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istiod-ca-cert\") pod \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") "
Oct 30 21:57:01.657312 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657293    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-token\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-token\") pod \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") "
Oct 30 21:57:01.657363 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657185    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-socket" pod "f3e39f0f-b5f7-40b9-a089-42ed027b1720" (UID: "f3e39f0f-b5f7-40b9-a089-42ed027b1720"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.657420 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657377    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-credential-socket" pod "f3e39f0f-b5f7-40b9-a089-42ed027b1720" (UID: "f3e39f0f-b5f7-40b9-a089-42ed027b1720"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.657489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657470    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-kube-api-access-zkc8j\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-kube-api-access-zkc8j\") pod \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") "
Oct 30 21:57:01.657547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657513    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-certs\") pod \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") "
Oct 30 21:57:01.657547 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657518    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-data" pod "f3e39f0f-b5f7-40b9-a089-42ed027b1720" (UID: "f3e39f0f-b5f7-40b9-a089-42ed027b1720"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.657725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657543    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-envoy\") pod \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\" (UID: \"f3e39f0f-b5f7-40b9-a089-42ed027b1720\") "
Oct 30 21:57:01.657725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.657576    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istiod-ca-cert" pod "f3e39f0f-b5f7-40b9-a089-42ed027b1720" (UID: "f3e39f0f-b5f7-40b9-a089-42ed027b1720"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:01.658240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.658204    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-certs" pod "f3e39f0f-b5f7-40b9-a089-42ed027b1720" (UID: "f3e39f0f-b5f7-40b9-a089-42ed027b1720"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.658356 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.658339    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.658427 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.658360    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.658427 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.658372    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.658427 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.658384    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.658427 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.658396    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.660295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.660258    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-token" pod "f3e39f0f-b5f7-40b9-a089-42ed027b1720" (UID: "f3e39f0f-b5f7-40b9-a089-42ed027b1720"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:01.660455 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.660432    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-kube-api-access-zkc8j" pod "f3e39f0f-b5f7-40b9-a089-42ed027b1720" (UID: "f3e39f0f-b5f7-40b9-a089-42ed027b1720"). InnerVolumeSpecName "kube-api-access-zkc8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:01.660692 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.660669    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-envoy" pod "f3e39f0f-b5f7-40b9-a089-42ed027b1720" (UID: "f3e39f0f-b5f7-40b9-a089-42ed027b1720"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.667124 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.667101    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-podinfo" pod "f3e39f0f-b5f7-40b9-a089-42ed027b1720" (UID: "f3e39f0f-b5f7-40b9-a089-42ed027b1720"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:57:01.759517 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759333    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istiod-ca-cert\") pod \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") "
Oct 30 21:57:01.759517 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759436    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-data\") pod \"da51dfef-219c-4058-a1ed-b69e8b08800a\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") "
Oct 30 21:57:01.759517 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759507    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-certs\") pod \"da51dfef-219c-4058-a1ed-b69e8b08800a\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") "
Oct 30 21:57:01.759840 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759575    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-podinfo\") pod \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") "
Oct 30 21:57:01.759840 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759671    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-kube-api-access-t4268\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-kube-api-access-t4268\") pod \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") "
Oct 30 21:57:01.759840 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759714    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-envoy\") pod \"da51dfef-219c-4058-a1ed-b69e8b08800a\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") "
Oct 30 21:57:01.759840 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759783    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-certs\") pod \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") "
Oct 30 21:57:01.759840 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759829    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-credential-socket\") pod \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") "
Oct 30 21:57:01.760202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759851    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-data" pod "da51dfef-219c-4058-a1ed-b69e8b08800a" (UID: "da51dfef-219c-4058-a1ed-b69e8b08800a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.760202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759861    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-envoy\") pod \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") "
Oct 30 21:57:01.760202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.759953    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-socket\") pod \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") "
Oct 30 21:57:01.760202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760052    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-podinfo\") pod \"da51dfef-219c-4058-a1ed-b69e8b08800a\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") "
Oct 30 21:57:01.760202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760120    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-credential-socket\") pod \"da51dfef-219c-4058-a1ed-b69e8b08800a\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") "
Oct 30 21:57:01.760202 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760192    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-socket\") pod \"da51dfef-219c-4058-a1ed-b69e8b08800a\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") "
Oct 30 21:57:01.760559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760200    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-certs" pod "da51dfef-219c-4058-a1ed-b69e8b08800a" (UID: "da51dfef-219c-4058-a1ed-b69e8b08800a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.760559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760246    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-kube-api-access-64dv6\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-kube-api-access-64dv6\") pod \"da51dfef-219c-4058-a1ed-b69e8b08800a\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") "
Oct 30 21:57:01.760559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760334    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-token\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-token\") pod \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") "
Oct 30 21:57:01.760559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760366    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-data\") pod \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\" (UID: \"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4\") "
Oct 30 21:57:01.760559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760468    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-token\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-token\") pod \"da51dfef-219c-4058-a1ed-b69e8b08800a\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") "
Oct 30 21:57:01.760559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760527    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/da51dfef-219c-4058-a1ed-b69e8b08800a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da51dfef-219c-4058-a1ed-b69e8b08800a-istiod-ca-cert\") pod \"da51dfef-219c-4058-a1ed-b69e8b08800a\" (UID: \"da51dfef-219c-4058-a1ed-b69e8b08800a\") "
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.760918    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-socket" pod "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" (UID: "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761299    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da51dfef-219c-4058-a1ed-b69e8b08800a-istiod-ca-cert" pod "da51dfef-219c-4058-a1ed-b69e8b08800a" (UID: "da51dfef-219c-4058-a1ed-b69e8b08800a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761511    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkc8j\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-kube-api-access-zkc8j\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761535    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761552    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761569    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761683    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da51dfef-219c-4058-a1ed-b69e8b08800a-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761700    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761715    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761722    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-credential-socket" pod "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" (UID: "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761730    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e39f0f-b5f7-40b9-a089-42ed027b1720-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.762160 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.761945    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-credential-socket" pod "da51dfef-219c-4058-a1ed-b69e8b08800a" (UID: "da51dfef-219c-4058-a1ed-b69e8b08800a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.763004 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.762184    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-socket" pod "da51dfef-219c-4058-a1ed-b69e8b08800a" (UID: "da51dfef-219c-4058-a1ed-b69e8b08800a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.763673 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.763635    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-podinfo" pod "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" (UID: "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:57:01.763894 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.763873    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-data" pod "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" (UID: "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.764272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.764246    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-certs" pod "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" (UID: "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.765158 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.765133    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istiod-ca-cert" pod "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" (UID: "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:01.765487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.765459    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-kube-api-access-64dv6" pod "da51dfef-219c-4058-a1ed-b69e8b08800a" (UID: "da51dfef-219c-4058-a1ed-b69e8b08800a"). InnerVolumeSpecName "kube-api-access-64dv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:01.765694 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.765676    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-envoy" pod "da51dfef-219c-4058-a1ed-b69e8b08800a" (UID: "da51dfef-219c-4058-a1ed-b69e8b08800a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.766517 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.766495    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-token" pod "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" (UID: "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:01.767292 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.767269    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-envoy" pod "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" (UID: "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:01.767381 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.767318    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-kube-api-access-t4268" pod "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" (UID: "01b29f70-02f7-4ccf-adc1-d3562ad5a3e4"). InnerVolumeSpecName "kube-api-access-t4268". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:01.769006 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.768947    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-podinfo" pod "da51dfef-219c-4058-a1ed-b69e8b08800a" (UID: "da51dfef-219c-4058-a1ed-b69e8b08800a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:57:01.769259 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.769229    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-token" pod "da51dfef-219c-4058-a1ed-b69e8b08800a" (UID: "da51dfef-219c-4058-a1ed-b69e8b08800a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:01.793774 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.793742    5575 generic.go:356] "Generic (PLEG): container finished" podID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerID="35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea" exitCode=0
Oct 30 21:57:01.793897 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.793812    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"
Oct 30 21:57:01.793897 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.793827    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" event={"ID":"da51dfef-219c-4058-a1ed-b69e8b08800a","Type":"ContainerDied","Data":"35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea"}
Oct 30 21:57:01.794029 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.793931    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn" event={"ID":"da51dfef-219c-4058-a1ed-b69e8b08800a","Type":"ContainerDied","Data":"a6afbf9ea9e31ad42d395dbb341ab3cc8b6ee5f448192a85ea767d8a9f61a2cb"}
Oct 30 21:57:01.794029 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.794014    5575 scope.go:122] "RemoveContainer" containerID="35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea"
Oct 30 21:57:01.795790 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.795720    5575 generic.go:356] "Generic (PLEG): container finished" podID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerID="790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b" exitCode=0
Oct 30 21:57:01.795915 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.795829    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" event={"ID":"f3e39f0f-b5f7-40b9-a089-42ed027b1720","Type":"ContainerDied","Data":"790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b"}
Oct 30 21:57:01.795915 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.795858    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"
Oct 30 21:57:01.796171 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.795863    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc" event={"ID":"f3e39f0f-b5f7-40b9-a089-42ed027b1720","Type":"ContainerDied","Data":"22b54daf3800ee70810819eea4625ba72a442f0c1b26d0bd6e567f130505f5c1"}
Oct 30 21:57:01.797548 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.797525    5575 generic.go:356] "Generic (PLEG): container finished" podID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerID="426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872" exitCode=0
Oct 30 21:57:01.797659 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.797564    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" event={"ID":"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4","Type":"ContainerDied","Data":"426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872"}
Oct 30 21:57:01.797659 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.797597    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w" event={"ID":"01b29f70-02f7-4ccf-adc1-d3562ad5a3e4","Type":"ContainerDied","Data":"a37b23e0e1c02ef03c8c68afdcb94e038bd8379da4d2b103ac11ecd44332170f"}
Oct 30 21:57:01.797659 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.797616    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"
Oct 30 21:57:01.816421 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.816391    5575 scope.go:122] "RemoveContainer" containerID="35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea"
Oct 30 21:57:01.817441 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:57:01.817411    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea\": container with ID starting with 35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea not found: ID does not exist" containerID="35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea"
Oct 30 21:57:01.818476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.817456    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea"} err="failed to get container status \"35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea\": rpc error: code = NotFound desc = could not find container \"35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea\": container with ID starting with 35365b4f45fe788fae3a9df1fb98516416208ece17b5c1abcc510ed4d36909ea not found: ID does not exist"
Oct 30 21:57:01.818476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.817646    5575 scope.go:122] "RemoveContainer" containerID="790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b"
Oct 30 21:57:01.840838 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.840555    5575 scope.go:122] "RemoveContainer" containerID="790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b"
Oct 30 21:57:01.842589 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:57:01.842515    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b\": container with ID starting with 790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b not found: ID does not exist" containerID="790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b"
Oct 30 21:57:01.842589 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.842564    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b"} err="failed to get container status \"790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b\": rpc error: code = NotFound desc = could not find container \"790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b\": container with ID starting with 790e8d41a13b46905aa8cdd6f4b20d2bcd7c5550a35b22bd07ae8cd86ddad25b not found: ID does not exist"
Oct 30 21:57:01.842835 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.842593    5575 scope.go:122] "RemoveContainer" containerID="426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872"
Oct 30 21:57:01.858497 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.858469    5575 scope.go:122] "RemoveContainer" containerID="426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872"
Oct 30 21:57:01.858887 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:57:01.858858    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872\": container with ID starting with 426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872 not found: ID does not exist" containerID="426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872"
Oct 30 21:57:01.859032 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.858901    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872"} err="failed to get container status \"426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872\": rpc error: code = NotFound desc = could not find container \"426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872\": container with ID starting with 426fb241a125186cd1f65c8053345f8f7b324d945b5088274388cc458215f872 not found: ID does not exist"
Oct 30 21:57:01.863164 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863141    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4268\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-kube-api-access-t4268\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863169    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863185    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863201    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863216    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863231    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863264 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863248    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863263    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da51dfef-219c-4058-a1ed-b69e8b08800a-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863279    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64dv6\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-kube-api-access-64dv6\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863288    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863297    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863307    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da51dfef-219c-4058-a1ed-b69e8b08800a-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863318    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:01.863494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:01.863328    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:02.062961 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:02.062881    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"]
Oct 30 21:57:02.066752 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:02.066727    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-nngqn"]
Oct 30 21:57:02.175697 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:02.175667    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"]
Oct 30 21:57:02.181585 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:02.181564    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-6ea374-openshift-default-84cc8c4467-zbv5w"]
Oct 30 21:57:02.289558 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:02.289527    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"]
Oct 30 21:57:02.293176 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:02.293153    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-5nscc"]
Oct 30 21:57:03.128272 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:03.128238    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" path="/var/lib/kubelet/pods/01b29f70-02f7-4ccf-adc1-d3562ad5a3e4/volumes"
Oct 30 21:57:03.128798 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:03.128782    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" path="/var/lib/kubelet/pods/da51dfef-219c-4058-a1ed-b69e8b08800a/volumes"
Oct 30 21:57:03.129280 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:03.129266    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" path="/var/lib/kubelet/pods/f3e39f0f-b5f7-40b9-a089-42ed027b1720/volumes"
Oct 30 21:57:04.411200 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.411139    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:57:04.597826 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.597794    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-token\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-token\") pod \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") "
Oct 30 21:57:04.598028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.597849    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-certs\") pod \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") "
Oct 30 21:57:04.598028 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.598009    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-kube-api-access-z9qb8\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-kube-api-access-z9qb8\") pod \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") "
Oct 30 21:57:04.598157 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.598092    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-data\") pod \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") "
Oct 30 21:57:04.598157 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.598128    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-podinfo\") pod \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") "
Oct 30 21:57:04.598263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.598223    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-credential-socket\") pod \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") "
Oct 30 21:57:04.598317 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.598286    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istiod-ca-cert\") pod \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") "
Oct 30 21:57:04.598381 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.598320    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-socket\") pod \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") "
Oct 30 21:57:04.598381 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.598223    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-certs" pod "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" (UID: "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:04.598493 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.598376    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-data" pod "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" (UID: "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:04.598493 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.598358    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-envoy\") pod \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\" (UID: \"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d\") "
Oct 30 21:57:04.599031 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.599007    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istiod-ca-cert" pod "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" (UID: "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:04.606174 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.606003    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-credential-socket" pod "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" (UID: "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:04.606174 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.606086    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:04.606174 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.606116    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:04.606174 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.606133    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:04.606174 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.606143    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-podinfo" pod "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" (UID: "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:57:04.606515 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.606322    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-socket" pod "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" (UID: "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:04.627320 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.627288    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-token" pod "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" (UID: "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:04.629758 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.629724    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-envoy" pod "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" (UID: "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:04.629882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.629839    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-kube-api-access-z9qb8" pod "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" (UID: "683905be-f8c6-4fe7-a065-f1c1fb4b0d3d"). InnerVolumeSpecName "kube-api-access-z9qb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:04.708265 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.708192    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:04.708265 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.708227    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:04.708265 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.708242    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:04.708265 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.708256    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9qb8\" (UniqueName: \"kubernetes.io/projected/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-kube-api-access-z9qb8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:04.708495 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.708272    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:04.708495 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.708285    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:04.826128 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.826093    5575 generic.go:356] "Generic (PLEG): container finished" podID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerID="96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64" exitCode=0
Oct 30 21:57:04.826294 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.826156    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"
Oct 30 21:57:04.826294 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.826162    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" event={"ID":"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d","Type":"ContainerDied","Data":"96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64"}
Oct 30 21:57:04.826367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.826295    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg" event={"ID":"683905be-f8c6-4fe7-a065-f1c1fb4b0d3d","Type":"ContainerDied","Data":"df30e4be9bd71fe8835f9fd9640ddb4a57ad882486e2df13c2cfcc95670ff978"}
Oct 30 21:57:04.826367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.826316    5575 scope.go:122] "RemoveContainer" containerID="96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64"
Oct 30 21:57:04.839018 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.839002    5575 scope.go:122] "RemoveContainer" containerID="96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64"
Oct 30 21:57:04.839340 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:57:04.839315    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64\": container with ID starting with 96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64 not found: ID does not exist" containerID="96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64"
Oct 30 21:57:04.839418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.839347    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64"} err="failed to get container status \"96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64\": rpc error: code = NotFound desc = could not find container \"96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64\": container with ID starting with 96a0f1ae330b6232a149e6e1c67c4cddef8c3ce6b3bc25b368b5fb9f0c547f64 not found: ID does not exist"
Oct 30 21:57:04.977064 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.976945    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:04.994030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:04.994001    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"]
Oct 30 21:57:05.049070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:05.049030    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-jkfmg"]
Oct 30 21:57:05.129107 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:05.129068    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" path="/var/lib/kubelet/pods/683905be-f8c6-4fe7-a065-f1c1fb4b0d3d/volumes"
Oct 30 21:57:09.869567 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:09.869527    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:14.167935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:14.167901    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"]
Oct 30 21:57:14.911206 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:14.911162    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl" podUID="8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" containerName="discovery" containerID="cri-o://5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1" gracePeriod=30
Oct 30 21:57:15.203371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.203347    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:57:15.254121 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.254087    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-kubeconfig\") pod \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") "
Oct 30 21:57:15.254312 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.254200    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-kube-api-access-4t5z8\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-kube-api-access-4t5z8\") pod \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") "
Oct 30 21:57:15.254312 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.254301    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-local-certs\") pod \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") "
Oct 30 21:57:15.254436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.254371    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-ca-configmap\") pod \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") "
Oct 30 21:57:15.254489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.254466    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-cacerts\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-cacerts\") pod \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") "
Oct 30 21:57:15.254540 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.254501    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-dns-cert\") pod \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") "
Oct 30 21:57:15.254590 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.254552    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-token\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-token\") pod \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\" (UID: \"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a\") "
Oct 30 21:57:15.255054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.255020    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-ca-configmap" pod "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" (UID: "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:15.255369 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.255348    5575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-ca-configmap\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:15.258738 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.258661    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-cacerts" pod "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" (UID: "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:57:15.258738 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.258701    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-dns-cert" pod "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" (UID: "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:57:15.258893 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.258755    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-kube-api-access-4t5z8" pod "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" (UID: "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a"). InnerVolumeSpecName "kube-api-access-4t5z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:15.258893 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.258803    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-local-certs" pod "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" (UID: "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:15.259169 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.259146    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-token" pod "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" (UID: "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:15.259348 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.259330    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-kubeconfig" pod "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" (UID: "8ea2b69b-aa67-4f35-8060-c4627ba9ea5a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:57:15.280214 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.280189    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:15.357524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.357485    5575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-kubeconfig\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:15.357524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.357524    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t5z8\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-kube-api-access-4t5z8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:15.357745 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.357542    5575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-local-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:15.357745 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.357555    5575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-cacerts\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:15.357745 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.357568    5575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-csr-dns-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:15.357745 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.357581    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:15.922252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.922208    5575 generic.go:356] "Generic (PLEG): container finished" podID="8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" containerID="5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1" exitCode=0
Oct 30 21:57:15.922252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.922238    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl" event={"ID":"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a","Type":"ContainerDied","Data":"5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1"}
Oct 30 21:57:15.922481 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.922306    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl" event={"ID":"8ea2b69b-aa67-4f35-8060-c4627ba9ea5a","Type":"ContainerDied","Data":"6f66c6f3b1892568f0836ceed2856c99e58ddb35ddb98a54f502d113a256c201"}
Oct 30 21:57:15.922481 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.922257    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"
Oct 30 21:57:15.922481 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.922333    5575 scope.go:122] "RemoveContainer" containerID="5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1"
Oct 30 21:57:15.935192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.935171    5575 scope.go:122] "RemoveContainer" containerID="5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1"
Oct 30 21:57:15.935468 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:57:15.935447    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1\": container with ID starting with 5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1 not found: ID does not exist" containerID="5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1"
Oct 30 21:57:15.935554 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:15.935475    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1"} err="failed to get container status \"5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1\": rpc error: code = NotFound desc = could not find container \"5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1\": container with ID starting with 5547679f76d472f16a747a1e265da2deb0d35d2b8c65942f3c5cff65a2524db1 not found: ID does not exist"
Oct 30 21:57:16.119551 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:16.119513    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"]
Oct 30 21:57:16.125404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:16.125380    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ncjhl"]
Oct 30 21:57:16.267072 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:16.266501    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:16.437932 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:16.437897    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:17.132163 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:17.132127    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" path="/var/lib/kubelet/pods/8ea2b69b-aa67-4f35-8060-c4627ba9ea5a/volumes"
Oct 30 21:57:20.509554 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:20.509470    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:23.589363 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:57:23.589174    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:57:25.551091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:25.551055    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:30.817556 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:30.817519    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:35.317079 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:35.316928    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:36.937991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:36.934254    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:37.227077 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.226993    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:37.380751 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.380721    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:37.515390 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.515308    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"]
Oct 30 21:57:37.516001 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.515950    5575 cpu_manager.go:414] "containerMap: removing container" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy"
Oct 30 21:57:37.516054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516004    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy"
Oct 30 21:57:37.516054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516025    5575 cpu_manager.go:414] "containerMap: removing container" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy"
Oct 30 21:57:37.516054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516031    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy"
Oct 30 21:57:37.516054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516040    5575 cpu_manager.go:414] "containerMap: removing container" podUID="d3997709-594e-469a-a373-a89ebd830d46" containerName="maas-api"
Oct 30 21:57:37.516054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516044    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3997709-594e-469a-a373-a89ebd830d46" containerName="maas-api"
Oct 30 21:57:37.516054 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516052    5575 cpu_manager.go:414] "containerMap: removing container" podUID="af55c619-d523-465c-8ee5-1de76ad781ac" containerName="payload-processing"
Oct 30 21:57:37.516238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516056    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af55c619-d523-465c-8ee5-1de76ad781ac" containerName="payload-processing"
Oct 30 21:57:37.516238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516077    5575 cpu_manager.go:414] "containerMap: removing container" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy"
Oct 30 21:57:37.516238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516081    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy"
Oct 30 21:57:37.516238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516095    5575 cpu_manager.go:414] "containerMap: removing container" podUID="8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" containerName="discovery"
Oct 30 21:57:37.516238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516099    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" containerName="discovery"
Oct 30 21:57:37.516238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516110    5575 cpu_manager.go:414] "containerMap: removing container" podUID="ca17539c-7cf8-48bf-b168-a20d208aae98" containerName="payload-pre-processing"
Oct 30 21:57:37.516238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516114    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca17539c-7cf8-48bf-b168-a20d208aae98" containerName="payload-pre-processing"
Oct 30 21:57:37.516238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516127    5575 cpu_manager.go:414] "containerMap: removing container" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy"
Oct 30 21:57:37.516238 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516132    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy"
Oct 30 21:57:37.516503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516245    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="01b29f70-02f7-4ccf-adc1-d3562ad5a3e4" containerName="istio-proxy"
Oct 30 21:57:37.516503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516257    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="da51dfef-219c-4058-a1ed-b69e8b08800a" containerName="istio-proxy"
Oct 30 21:57:37.516503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516263    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3e39f0f-b5f7-40b9-a089-42ed027b1720" containerName="istio-proxy"
Oct 30 21:57:37.516503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516270    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3997709-594e-469a-a373-a89ebd830d46" containerName="maas-api"
Oct 30 21:57:37.516503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516276    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="af55c619-d523-465c-8ee5-1de76ad781ac" containerName="payload-processing"
Oct 30 21:57:37.516503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516285    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="683905be-f8c6-4fe7-a065-f1c1fb4b0d3d" containerName="istio-proxy"
Oct 30 21:57:37.516503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516292    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ea2b69b-aa67-4f35-8060-c4627ba9ea5a" containerName="discovery"
Oct 30 21:57:37.516503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.516298    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca17539c-7cf8-48bf-b168-a20d208aae98" containerName="payload-pre-processing"
Oct 30 21:57:37.521927 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.521905    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.586456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.586419    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112686fc-ba64-40ff-8206-45381e35c8bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.586456 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.586460    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.586743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.586685    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5f2f\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-kube-api-access-s5f2f\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.586743 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.586730    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.587227 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.586767    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.587358 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.587261    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.587595 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.587563    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112686fc-ba64-40ff-8206-45381e35c8bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.587725 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.587656    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.587792 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.587745    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.630494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.630465    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"]
Oct 30 21:57:37.689267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689231    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112686fc-ba64-40ff-8206-45381e35c8bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.689267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689267    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.689524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689353    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5f2f\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-kube-api-access-s5f2f\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.689524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689390    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.689524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689426    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.689524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689461    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.689524 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689493    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112686fc-ba64-40ff-8206-45381e35c8bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.689791 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689571    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.689791 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689602    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.689929 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689901    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.690039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.689935    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.690116 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.690100    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.690338 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.690146    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.690413 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.690394    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112686fc-ba64-40ff-8206-45381e35c8bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.691960 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.691935    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.692084 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.692061    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112686fc-ba64-40ff-8206-45381e35c8bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.750529 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.750497    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.750635 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.750620    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5f2f\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-kube-api-access-s5f2f\") pod \"maas-default-gateway-openshift-default-75d7c785f-4jscr\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.836812 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.836748    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:37.967899 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:37.967851    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:38.273547 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:57:38.273519    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112686fc_ba64_40ff_8206_45381e35c8bc.slice/crio-dbcf55d1933a1fee6874e158aa640193979dfcba7623162148a6da0ae07a58ce WatchSource:0}: Error finding container dbcf55d1933a1fee6874e158aa640193979dfcba7623162148a6da0ae07a58ce: Status 404 returned error can't find the container with id dbcf55d1933a1fee6874e158aa640193979dfcba7623162148a6da0ae07a58ce
Oct 30 21:57:38.274218 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:38.274195    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"]
Oct 30 21:57:38.276570 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:38.276539    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:57:38.276690 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:38.276607    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:57:38.276690 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:38.276636    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:57:38.758852 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:38.758819    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"]
Oct 30 21:57:39.148113 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:39.148079    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:39.275533 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:39.275489    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" event={"ID":"112686fc-ba64-40ff-8206-45381e35c8bc","Type":"ContainerStarted","Data":"d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece"}
Oct 30 21:57:39.275708 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:39.275559    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" event={"ID":"112686fc-ba64-40ff-8206-45381e35c8bc","Type":"ContainerStarted","Data":"dbcf55d1933a1fee6874e158aa640193979dfcba7623162148a6da0ae07a58ce"}
Oct 30 21:57:39.349252 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:39.349220    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:39.401004 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:39.400872    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podStartSLOduration=2.400856337 podStartE2EDuration="2.400856337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:57:39.398314613 +0000 UTC m=+2060.430163148" watchObservedRunningTime="2026-10-30 21:57:39.400856337 +0000 UTC m=+2060.432704871"
Oct 30 21:57:39.838303 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:39.838201    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:39.839821 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:39.839791    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-4jscr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 21:57:39.840070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:39.840035    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 21:57:40.837556 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:40.837519    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-4jscr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 21:57:40.838087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:40.837594    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 21:57:41.837493 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:41.837451    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-4jscr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 21:57:41.837667 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:41.837509    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 21:57:42.837653 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:42.837616    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-4jscr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 21:57:42.837851 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:42.837679    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 21:57:43.091447 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:43.091339    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:43.759546 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:43.759501    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv" podUID="e7fbb4b5-b446-4463-91a5-65a874af96e9" containerName="payload-processing" containerID="cri-o://3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a" gracePeriod=25
Oct 30 21:57:43.837433 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:43.837399    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-4jscr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 21:57:43.837602 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:43.837459    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 21:57:44.086846 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.086546    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:57:44.167046 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.167014    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7fbb4b5-b446-4463-91a5-65a874af96e9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fbb4b5-b446-4463-91a5-65a874af96e9-plugins-config-volume\") pod \"e7fbb4b5-b446-4463-91a5-65a874af96e9\" (UID: \"e7fbb4b5-b446-4463-91a5-65a874af96e9\") "
Oct 30 21:57:44.167235 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.167131    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7fbb4b5-b446-4463-91a5-65a874af96e9-kube-api-access-6rt2k\" (UniqueName: \"kubernetes.io/projected/e7fbb4b5-b446-4463-91a5-65a874af96e9-kube-api-access-6rt2k\") pod \"e7fbb4b5-b446-4463-91a5-65a874af96e9\" (UID: \"e7fbb4b5-b446-4463-91a5-65a874af96e9\") "
Oct 30 21:57:44.167593 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.167559    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7fbb4b5-b446-4463-91a5-65a874af96e9-plugins-config-volume" pod "e7fbb4b5-b446-4463-91a5-65a874af96e9" (UID: "e7fbb4b5-b446-4463-91a5-65a874af96e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:44.169882 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.169857    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7fbb4b5-b446-4463-91a5-65a874af96e9-kube-api-access-6rt2k" pod "e7fbb4b5-b446-4463-91a5-65a874af96e9" (UID: "e7fbb4b5-b446-4463-91a5-65a874af96e9"). InnerVolumeSpecName "kube-api-access-6rt2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:44.269105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.269069    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rt2k\" (UniqueName: \"kubernetes.io/projected/e7fbb4b5-b446-4463-91a5-65a874af96e9-kube-api-access-6rt2k\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:44.269105 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.269104    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fbb4b5-b446-4463-91a5-65a874af96e9-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:44.339087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.338992    5575 generic.go:356] "Generic (PLEG): container finished" podID="e7fbb4b5-b446-4463-91a5-65a874af96e9" containerID="3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a" exitCode=0
Oct 30 21:57:44.339087 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.339070    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"
Oct 30 21:57:44.339311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.339099    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv" event={"ID":"e7fbb4b5-b446-4463-91a5-65a874af96e9","Type":"ContainerDied","Data":"3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a"}
Oct 30 21:57:44.339311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.339157    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv" event={"ID":"e7fbb4b5-b446-4463-91a5-65a874af96e9","Type":"ContainerDied","Data":"3e40e74d284270c9f2df7cbe4a0e8d8128f83efe5a7c72570d0a8a15cc7ca5d0"}
Oct 30 21:57:44.339311 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.339182    5575 scope.go:122] "RemoveContainer" containerID="3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a"
Oct 30 21:57:44.362059 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.362029    5575 scope.go:122] "RemoveContainer" containerID="3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a"
Oct 30 21:57:44.362441 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:57:44.362420    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a\": container with ID starting with 3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a not found: ID does not exist" containerID="3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a"
Oct 30 21:57:44.362497 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.362452    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a"} err="failed to get container status \"3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a\": rpc error: code = NotFound desc = could not find container \"3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a\": container with ID starting with 3bee7c7d235fc22e63738c879a4990b9b3c23db3606610db9ce67dd05e3ff37a not found: ID does not exist"
Oct 30 21:57:44.423550 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.423519    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:44.516443 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.516414    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"]
Oct 30 21:57:44.522901 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.522873    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c92783-7875686574-kgkkv"]
Oct 30 21:57:44.622374 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.622292    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:44.837511 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.837460    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-4jscr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 21:57:44.837698 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:44.837545    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 21:57:45.013124 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:45.010322    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:45.149478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:45.149440    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7fbb4b5-b446-4463-91a5-65a874af96e9" path="/var/lib/kubelet/pods/e7fbb4b5-b446-4463-91a5-65a874af96e9/volumes"
Oct 30 21:57:45.838167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:45.838124    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-4jscr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 21:57:45.838343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:45.838206    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 21:57:46.973343 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:46.973314    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:46.973860 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:46.973809    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:46.974926 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:46.974894    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 21:57:47.166127 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:47.166096    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:48.150988 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.150769    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"]
Oct 30 21:57:48.151494 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.151038    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5" podUID="56220335-a914-47a8-ae41-b6ea0652ad67" containerName="maas-api" containerID="cri-o://2cf209da23a2140a06a6369862ad909cbf545e45f6a72112ee13646671ed0437" gracePeriod=30
Oct 30 21:57:48.248987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.248864    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:48.372961 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.372923    5575 generic.go:356] "Generic (PLEG): container finished" podID="56220335-a914-47a8-ae41-b6ea0652ad67" containerID="2cf209da23a2140a06a6369862ad909cbf545e45f6a72112ee13646671ed0437" exitCode=0
Oct 30 21:57:48.373156 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.373003    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5" event={"ID":"56220335-a914-47a8-ae41-b6ea0652ad67","Type":"ContainerDied","Data":"2cf209da23a2140a06a6369862ad909cbf545e45f6a72112ee13646671ed0437"}
Oct 30 21:57:48.525647 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.525619    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:57:48.564250 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.564223    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-metrics-certs\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-metrics-certs\") pod \"56220335-a914-47a8-ae41-b6ea0652ad67\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") "
Oct 30 21:57:48.564404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.564268    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56220335-a914-47a8-ae41-b6ea0652ad67-kube-api-access-tl8d5\" (UniqueName: \"kubernetes.io/projected/56220335-a914-47a8-ae41-b6ea0652ad67-kube-api-access-tl8d5\") pod \"56220335-a914-47a8-ae41-b6ea0652ad67\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") "
Oct 30 21:57:48.564404 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.564369    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls\") pod \"56220335-a914-47a8-ae41-b6ea0652ad67\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") "
Oct 30 21:57:48.564485 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.564433    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56220335-a914-47a8-ae41-b6ea0652ad67-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56220335-a914-47a8-ae41-b6ea0652ad67-openshift-service-ca\") pod \"56220335-a914-47a8-ae41-b6ea0652ad67\" (UID: \"56220335-a914-47a8-ae41-b6ea0652ad67\") "
Oct 30 21:57:48.564880 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.564853    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56220335-a914-47a8-ae41-b6ea0652ad67-openshift-service-ca" pod "56220335-a914-47a8-ae41-b6ea0652ad67" (UID: "56220335-a914-47a8-ae41-b6ea0652ad67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:48.565232 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.565064    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56220335-a914-47a8-ae41-b6ea0652ad67-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:48.566643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.566617    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls" pod "56220335-a914-47a8-ae41-b6ea0652ad67" (UID: "56220335-a914-47a8-ae41-b6ea0652ad67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:57:48.566739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.566654    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-metrics-certs" pod "56220335-a914-47a8-ae41-b6ea0652ad67" (UID: "56220335-a914-47a8-ae41-b6ea0652ad67"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:57:48.566898 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.566881    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56220335-a914-47a8-ae41-b6ea0652ad67-kube-api-access-tl8d5" pod "56220335-a914-47a8-ae41-b6ea0652ad67" (UID: "56220335-a914-47a8-ae41-b6ea0652ad67"). InnerVolumeSpecName "kube-api-access-tl8d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:48.666992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.666215    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:48.666992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.666250    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl8d5\" (UniqueName: \"kubernetes.io/projected/56220335-a914-47a8-ae41-b6ea0652ad67-kube-api-access-tl8d5\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:48.666992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:48.666264    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56220335-a914-47a8-ae41-b6ea0652ad67-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:49.422045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:49.421076    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5" event={"ID":"56220335-a914-47a8-ae41-b6ea0652ad67","Type":"ContainerDied","Data":"a7e447b5097c9e595b22dc26511dbe5a25eb001d8f2da7b8779f1c59e5b729f9"}
Oct 30 21:57:49.422045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:49.421149    5575 scope.go:122] "RemoveContainer" containerID="2cf209da23a2140a06a6369862ad909cbf545e45f6a72112ee13646671ed0437"
Oct 30 21:57:49.422045 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:49.421297    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"
Oct 30 21:57:49.593739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:49.593702    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"]
Oct 30 21:57:49.641201 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:49.641170    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-259e81-7d56c8c678-f9zw5"]
Oct 30 21:57:50.151706 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:50.151669    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:50.361869 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:50.361834    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:50.562738 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:50.562648    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:51.128841 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:51.128802    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56220335-a914-47a8-ae41-b6ea0652ad67" path="/var/lib/kubelet/pods/56220335-a914-47a8-ae41-b6ea0652ad67/volumes"
Oct 30 21:57:52.593785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:52.593755    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:53.071052 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:53.071018    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"]
Oct 30 21:57:53.184762 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:53.184726    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"]
Oct 30 21:57:53.444391 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:53.444354    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:53.522041 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:57:53.521692    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:57:53.611643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:53.611603    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:55.779078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:55.779042    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:58.071478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.071441    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg" podUID="b1fe2131-ed20-4602-b74c-6ee6dcf05c77" containerName="payload-processing" containerID="cri-o://83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd" gracePeriod=25
Oct 30 21:57:58.117771 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.117739    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"]
Oct 30 21:57:58.118488 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.118467    5575 cpu_manager.go:414] "containerMap: removing container" podUID="e7fbb4b5-b446-4463-91a5-65a874af96e9" containerName="payload-processing"
Oct 30 21:57:58.118587 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.118489    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7fbb4b5-b446-4463-91a5-65a874af96e9" containerName="payload-processing"
Oct 30 21:57:58.118587 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.118506    5575 cpu_manager.go:414] "containerMap: removing container" podUID="56220335-a914-47a8-ae41-b6ea0652ad67" containerName="maas-api"
Oct 30 21:57:58.118587 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.118513    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56220335-a914-47a8-ae41-b6ea0652ad67" containerName="maas-api"
Oct 30 21:57:58.118770 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.118756    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7fbb4b5-b446-4463-91a5-65a874af96e9" containerName="payload-processing"
Oct 30 21:57:58.118826 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.118775    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="56220335-a914-47a8-ae41-b6ea0652ad67" containerName="maas-api"
Oct 30 21:57:58.122923 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.122904    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.176134 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.176102    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-fd2a94-openshift-default-dockercfg-qmcvv\""
Oct 30 21:57:58.185243 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.185199    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb" podUID="8b21d8ad-3036-412d-a2f6-883f525618e3" containerName="payload-pre-processing" containerID="cri-o://281150efd8dc4c9ca7eb00e6f425b61ede70f12915bc3128f5db9c485b0fc361" gracePeriod=25
Oct 30 21:57:58.217215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.213263    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:58.246656 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.241397    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"]
Oct 30 21:57:58.262619 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.262573    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-credential-socket\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.262805 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.262658    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istiod-ca-cert\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.262805 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.262722    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-podinfo\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.262805 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.262791    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-token\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.262994 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.262952    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-certs\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.263061 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.263023    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-envoy\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.263230 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.263209    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k8kx\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-kube-api-access-5k8kx\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.263299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.263249    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-socket\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.263299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.263276    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-data\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.364932 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.364898    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k8kx\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-kube-api-access-5k8kx\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.365137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.364939    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-socket\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.365137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.364961    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-data\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.365137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.365039    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-credential-socket\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.365137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.365071    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istiod-ca-cert\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.365137 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.365110    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-podinfo\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.365299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.365169    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-token\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.365299 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.365283    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-certs\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.365367 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.365322    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-envoy\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.366115 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.366091    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-credential-socket\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.367336 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.367042    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-data\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.368265 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.367947    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istiod-ca-cert\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.369192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.369163    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-socket\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.369386 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.369365    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-certs\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.369604 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.369584    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-envoy\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.373933 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.373897    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-podinfo\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.451285 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.451219    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-token\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.451574 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.451543    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k8kx\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-kube-api-access-5k8kx\") pod \"e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") " pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.458386 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.458347    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:57:58.521991 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.520166    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:57:58.544335 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.541575    5575 generic.go:356] "Generic (PLEG): container finished" podID="8b21d8ad-3036-412d-a2f6-883f525618e3" containerID="281150efd8dc4c9ca7eb00e6f425b61ede70f12915bc3128f5db9c485b0fc361" exitCode=0
Oct 30 21:57:58.544335 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.541848    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb" event={"ID":"8b21d8ad-3036-412d-a2f6-883f525618e3","Type":"ContainerDied","Data":"281150efd8dc4c9ca7eb00e6f425b61ede70f12915bc3128f5db9c485b0fc361"}
Oct 30 21:57:58.545723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.545183    5575 generic.go:356] "Generic (PLEG): container finished" podID="b1fe2131-ed20-4602-b74c-6ee6dcf05c77" containerID="83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd" exitCode=0
Oct 30 21:57:58.545723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.545277    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg" event={"ID":"b1fe2131-ed20-4602-b74c-6ee6dcf05c77","Type":"ContainerDied","Data":"83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd"}
Oct 30 21:57:58.545723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.545323    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg" event={"ID":"b1fe2131-ed20-4602-b74c-6ee6dcf05c77","Type":"ContainerDied","Data":"3c94ddb81a397c72199a044f5734641f420a530c667d59596c43146d211ba76d"}
Oct 30 21:57:58.545723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.545350    5575 scope.go:122] "RemoveContainer" containerID="83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd"
Oct 30 21:57:58.545723 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.545507    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"
Oct 30 21:57:58.556123 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.556075    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:58.567935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.567623    5575 scope.go:122] "RemoveContainer" containerID="83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd"
Oct 30 21:57:58.568679 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:57:58.568194    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd\": container with ID starting with 83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd not found: ID does not exist" containerID="83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd"
Oct 30 21:57:58.568679 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.568235    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd"} err="failed to get container status \"83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd\": rpc error: code = NotFound desc = could not find container \"83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd\": container with ID starting with 83bd06d908b1c8b77d77ab7c8a2daee4f5092b0d51711200b5addbcec00d01fd not found: ID does not exist"
Oct 30 21:57:58.601256 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.601231    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:57:58.670487 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.670454    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-plugins-config-volume\") pod \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\" (UID: \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\") "
Oct 30 21:57:58.670650 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.670525    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-kube-api-access-tfgcf\" (UniqueName: \"kubernetes.io/projected/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-kube-api-access-tfgcf\") pod \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\" (UID: \"b1fe2131-ed20-4602-b74c-6ee6dcf05c77\") "
Oct 30 21:57:58.671031 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.671004    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-plugins-config-volume" pod "b1fe2131-ed20-4602-b74c-6ee6dcf05c77" (UID: "b1fe2131-ed20-4602-b74c-6ee6dcf05c77"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:58.671170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.671056    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8b21d8ad-3036-412d-a2f6-883f525618e3-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b21d8ad-3036-412d-a2f6-883f525618e3-plugins-config-volume\") pod \"8b21d8ad-3036-412d-a2f6-883f525618e3\" (UID: \"8b21d8ad-3036-412d-a2f6-883f525618e3\") "
Oct 30 21:57:58.671170 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.671119    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b21d8ad-3036-412d-a2f6-883f525618e3-kube-api-access-hw8wp\" (UniqueName: \"kubernetes.io/projected/8b21d8ad-3036-412d-a2f6-883f525618e3-kube-api-access-hw8wp\") pod \"8b21d8ad-3036-412d-a2f6-883f525618e3\" (UID: \"8b21d8ad-3036-412d-a2f6-883f525618e3\") "
Oct 30 21:57:58.671550 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.671514    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b21d8ad-3036-412d-a2f6-883f525618e3-plugins-config-volume" pod "8b21d8ad-3036-412d-a2f6-883f525618e3" (UID: "8b21d8ad-3036-412d-a2f6-883f525618e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:58.671793 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.671769    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b21d8ad-3036-412d-a2f6-883f525618e3-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:58.672068 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.671798    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:58.673455 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.673424    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b21d8ad-3036-412d-a2f6-883f525618e3-kube-api-access-hw8wp" pod "8b21d8ad-3036-412d-a2f6-883f525618e3" (UID: "8b21d8ad-3036-412d-a2f6-883f525618e3"). InnerVolumeSpecName "kube-api-access-hw8wp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:58.673643 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.673614    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-kube-api-access-tfgcf" pod "b1fe2131-ed20-4602-b74c-6ee6dcf05c77" (UID: "b1fe2131-ed20-4602-b74c-6ee6dcf05c77"). InnerVolumeSpecName "kube-api-access-tfgcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:58.773220 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.773182    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw8wp\" (UniqueName: \"kubernetes.io/projected/8b21d8ad-3036-412d-a2f6-883f525618e3-kube-api-access-hw8wp\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:58.773220 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.773223    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfgcf\" (UniqueName: \"kubernetes.io/projected/b1fe2131-ed20-4602-b74c-6ee6dcf05c77-kube-api-access-tfgcf\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:58.972897 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.972857    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"]
Oct 30 21:57:58.973050 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:57:58.972940    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538d4aa7_ce5c_4ef5_a393_6e89a9d939ef.slice/crio-1c59eef993810de23daf97d8068e4c029bdfd8332c29e4968c652d068b940129 WatchSource:0}: Error finding container 1c59eef993810de23daf97d8068e4c029bdfd8332c29e4968c652d068b940129: Status 404 returned error can't find the container with id 1c59eef993810de23daf97d8068e4c029bdfd8332c29e4968c652d068b940129
Oct 30 21:57:58.976267 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.976229    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:57:58.976364 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.976312    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:57:58.976420 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.976358    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:57:58.977206 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.977188    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"]
Oct 30 21:57:58.981098 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:58.981076    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-d6e0be-56bd79888-z9kkg"]
Oct 30 21:57:59.129924 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:59.129850    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1fe2131-ed20-4602-b74c-6ee6dcf05c77" path="/var/lib/kubelet/pods/b1fe2131-ed20-4602-b74c-6ee6dcf05c77/volumes"
Oct 30 21:57:59.557053 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:59.557014    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" event={"ID":"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef","Type":"ContainerStarted","Data":"ab67a402c473308a79f5e91689250b03fd28b13d2fd45c9a21e9a0148ac888de"}
Oct 30 21:57:59.557240 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:59.557088    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" event={"ID":"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef","Type":"ContainerStarted","Data":"1c59eef993810de23daf97d8068e4c029bdfd8332c29e4968c652d068b940129"}
Oct 30 21:57:59.559544 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:59.559524    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"
Oct 30 21:57:59.559658 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:59.559557    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb" event={"ID":"8b21d8ad-3036-412d-a2f6-883f525618e3","Type":"ContainerDied","Data":"3b69b2fddc23dfc698ec42de680e18a9c890e42be7e191c38ccd399e4d4934d7"}
Oct 30 21:57:59.559658 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:59.559612    5575 scope.go:122] "RemoveContainer" containerID="281150efd8dc4c9ca7eb00e6f425b61ede70f12915bc3128f5db9c485b0fc361"
Oct 30 21:57:59.681722 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:59.681667    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" podStartSLOduration=1.6816541649999999 podStartE2EDuration="1.681654165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:57:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:57:59.677486908 +0000 UTC m=+2080.709335453" watchObservedRunningTime="2026-10-30 21:57:59.681654165 +0000 UTC m=+2080.713502700"
Oct 30 21:57:59.796106 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:59.794149    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"]
Oct 30 21:57:59.846006 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:57:59.845800    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-d6e0be-5b48df4699-jczjb"]
Oct 30 21:58:00.173763 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:00.173727    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:00.459448 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:00.459364    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:58:00.464904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:00.464881    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:58:00.568960 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:00.568929    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:58:00.569883 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:00.569861    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 21:58:00.862833 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:00.862742    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:01.092167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:01.092131    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:01.127891 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:01.127811    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b21d8ad-3036-412d-a2f6-883f525618e3" path="/var/lib/kubelet/pods/8b21d8ad-3036-412d-a2f6-883f525618e3/volumes"
Oct 30 21:58:02.632954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:02.632927    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:02.796048 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:02.796019    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:05.893039 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:05.892955    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:06.132904 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.132848    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:06.311249 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.311170    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:06.312655 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.312635    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"]
Oct 30 21:58:06.313413 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.313396    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b1fe2131-ed20-4602-b74c-6ee6dcf05c77" containerName="payload-processing"
Oct 30 21:58:06.313470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.313415    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1fe2131-ed20-4602-b74c-6ee6dcf05c77" containerName="payload-processing"
Oct 30 21:58:06.313470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.313424    5575 cpu_manager.go:414] "containerMap: removing container" podUID="8b21d8ad-3036-412d-a2f6-883f525618e3" containerName="payload-pre-processing"
Oct 30 21:58:06.313470 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.313431    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b21d8ad-3036-412d-a2f6-883f525618e3" containerName="payload-pre-processing"
Oct 30 21:58:06.313598 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.313588    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1fe2131-ed20-4602-b74c-6ee6dcf05c77" containerName="payload-processing"
Oct 30 21:58:06.313632 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.313601    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b21d8ad-3036-412d-a2f6-883f525618e3" containerName="payload-pre-processing"
Oct 30 21:58:06.318492 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.318473    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:06.373016 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.372955    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-fd2a94-dockercfg-qztfl\""
Oct 30 21:58:06.377670 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.377643    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"]
Oct 30 21:58:06.527053 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.523858    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49940fb5-e60d-4e3b-a2d9-fa539392a145-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg\" (UID: \"49940fb5-e60d-4e3b-a2d9-fa539392a145\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:06.527053 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.523935    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9q9k\" (UniqueName: \"kubernetes.io/projected/49940fb5-e60d-4e3b-a2d9-fa539392a145-kube-api-access-q9q9k\") pod \"payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg\" (UID: \"49940fb5-e60d-4e3b-a2d9-fa539392a145\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:06.527053 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.524274    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-fd2a94\""
Oct 30 21:58:06.549992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.539467    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"]
Oct 30 21:58:06.549992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.548134    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:06.569036 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.558722    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"]
Oct 30 21:58:06.658085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.658049    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq\" (UID: \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:06.658268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.658097    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49940fb5-e60d-4e3b-a2d9-fa539392a145-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg\" (UID: \"49940fb5-e60d-4e3b-a2d9-fa539392a145\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:06.658268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.658194    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9q9k\" (UniqueName: \"kubernetes.io/projected/49940fb5-e60d-4e3b-a2d9-fa539392a145-kube-api-access-q9q9k\") pod \"payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg\" (UID: \"49940fb5-e60d-4e3b-a2d9-fa539392a145\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:06.658268 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.658248    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqfx5\" (UniqueName: \"kubernetes.io/projected/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-kube-api-access-jqfx5\") pod \"payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq\" (UID: \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:06.658952 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.658935    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49940fb5-e60d-4e3b-a2d9-fa539392a145-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg\" (UID: \"49940fb5-e60d-4e3b-a2d9-fa539392a145\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:06.719464 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.719433    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9q9k\" (UniqueName: \"kubernetes.io/projected/49940fb5-e60d-4e3b-a2d9-fa539392a145-kube-api-access-q9q9k\") pod \"payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg\" (UID: \"49940fb5-e60d-4e3b-a2d9-fa539392a145\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:06.760037 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.759934    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq\" (UID: \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:06.760037 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.760029    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfx5\" (UniqueName: \"kubernetes.io/projected/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-kube-api-access-jqfx5\") pod \"payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq\" (UID: \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:06.760728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.760707    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq\" (UID: \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:06.821713 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.821642    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqfx5\" (UniqueName: \"kubernetes.io/projected/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-kube-api-access-jqfx5\") pod \"payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq\" (UID: \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:06.890432 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.890399    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:06.932254 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:06.932229    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:07.448025 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.447981    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"]
Oct 30 21:58:07.449095 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:58:07.449066    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3aedb2b_13cd_44ea_bb42_30d2c827aa8b.slice/crio-377e6975e05ec88f8eabfb76c4e39e9ac73d073b832a4deb4d1532776352598b WatchSource:0}: Error finding container 377e6975e05ec88f8eabfb76c4e39e9ac73d073b832a4deb4d1532776352598b: Status 404 returned error can't find the container with id 377e6975e05ec88f8eabfb76c4e39e9ac73d073b832a4deb4d1532776352598b
Oct 30 21:58:07.510885 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:58:07.510852    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49940fb5_e60d_4e3b_a2d9_fa539392a145.slice/crio-ebbc9b341b1d8cd045d8aa000b2935ae9a8c88a54579b880e740552b97492bda WatchSource:0}: Error finding container ebbc9b341b1d8cd045d8aa000b2935ae9a8c88a54579b880e740552b97492bda: Status 404 returned error can't find the container with id ebbc9b341b1d8cd045d8aa000b2935ae9a8c88a54579b880e740552b97492bda
Oct 30 21:58:07.511034 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.510928    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"]
Oct 30 21:58:07.635310 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.635269    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq" event={"ID":"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b","Type":"ContainerStarted","Data":"339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3"}
Oct 30 21:58:07.635471 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.635336    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:07.635471 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.635361    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq" event={"ID":"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b","Type":"ContainerStarted","Data":"377e6975e05ec88f8eabfb76c4e39e9ac73d073b832a4deb4d1532776352598b"}
Oct 30 21:58:07.636831 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.636809    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg" event={"ID":"49940fb5-e60d-4e3b-a2d9-fa539392a145","Type":"ContainerStarted","Data":"1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595"}
Oct 30 21:58:07.636987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.636852    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg" event={"ID":"49940fb5-e60d-4e3b-a2d9-fa539392a145","Type":"ContainerStarted","Data":"ebbc9b341b1d8cd045d8aa000b2935ae9a8c88a54579b880e740552b97492bda"}
Oct 30 21:58:07.636987 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.636923    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:07.751562 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.751471    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq" podStartSLOduration=1.751457469 podStartE2EDuration="1.751457469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:07.750686842 +0000 UTC m=+2088.782535381" watchObservedRunningTime="2026-10-30 21:58:07.751457469 +0000 UTC m=+2088.783306004"
Oct 30 21:58:07.871760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.871707    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg" podStartSLOduration=1.871693329 podStartE2EDuration="1.871693329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:07.86743725 +0000 UTC m=+2088.899285785" watchObservedRunningTime="2026-10-30 21:58:07.871693329 +0000 UTC m=+2088.903541864"
Oct 30 21:58:07.915734 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:07.915692    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:08.077334 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:08.077246    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:11.357697 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:11.357660    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:13.377409 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:13.377381    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:13.562519 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:13.562481    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:15.586155 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:15.586120    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:17.291950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:17.291914    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:17.507607 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:17.507565    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:17.683051 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:17.682989    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:18.289397 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:18.289363    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"]
Oct 30 21:58:18.289640 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:18.289615    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy" containerID="cri-o://bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966" gracePeriod=30
Oct 30 21:58:18.468249 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:18.468185    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:18.648075 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:18.648046    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 21:58:18.648507 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:18.648487    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 21:58:19.557419 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:19.557384    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:58:19.557908 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:19.557762    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 21:58:19.575085 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:19.575062    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:58:19.575977 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:19.575942    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 21:58:22.770070 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:22.770039    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:23.509421 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:58:23.509380    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:58:23.579765 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.579737    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:58:23.651669 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.651637    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-token\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-token\") pod \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") "
Oct 30 21:58:23.651840 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.651693    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-socket\") pod \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") "
Oct 30 21:58:23.651840 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.651790    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-data\") pod \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") "
Oct 30 21:58:23.651924 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.651879    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-credential-socket\") pod \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") "
Oct 30 21:58:23.651924 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.651919    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-certs\") pod \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") "
Oct 30 21:58:23.652096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.651997    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-envoy\") pod \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") "
Oct 30 21:58:23.652096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652033    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-podinfo\") pod \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") "
Oct 30 21:58:23.652096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652047    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-socket" pod "fa9b9295-3acd-4cb9-8d87-32560888e3cf" (UID: "fa9b9295-3acd-4cb9-8d87-32560888e3cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:23.652096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652076    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-data" pod "fa9b9295-3acd-4cb9-8d87-32560888e3cf" (UID: "fa9b9295-3acd-4cb9-8d87-32560888e3cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:23.652096 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652084    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istiod-ca-cert\") pod \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") "
Oct 30 21:58:23.652347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652175    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-kube-api-access-vkkwx\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-kube-api-access-vkkwx\") pod \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\" (UID: \"fa9b9295-3acd-4cb9-8d87-32560888e3cf\") "
Oct 30 21:58:23.652347 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652255    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-certs" pod "fa9b9295-3acd-4cb9-8d87-32560888e3cf" (UID: "fa9b9295-3acd-4cb9-8d87-32560888e3cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:23.652427 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652338    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-credential-socket" pod "fa9b9295-3acd-4cb9-8d87-32560888e3cf" (UID: "fa9b9295-3acd-4cb9-8d87-32560888e3cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:23.652482 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652453    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istiod-ca-cert" pod "fa9b9295-3acd-4cb9-8d87-32560888e3cf" (UID: "fa9b9295-3acd-4cb9-8d87-32560888e3cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:58:23.652821 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652801    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:23.652821 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652821    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:23.653184 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652830    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:23.653184 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652838    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:23.653184 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.652847    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:23.654369 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.654342    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-token" pod "fa9b9295-3acd-4cb9-8d87-32560888e3cf" (UID: "fa9b9295-3acd-4cb9-8d87-32560888e3cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:58:23.654478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.654393    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-envoy" pod "fa9b9295-3acd-4cb9-8d87-32560888e3cf" (UID: "fa9b9295-3acd-4cb9-8d87-32560888e3cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:23.654673 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.654649    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-kube-api-access-vkkwx" pod "fa9b9295-3acd-4cb9-8d87-32560888e3cf" (UID: "fa9b9295-3acd-4cb9-8d87-32560888e3cf"). InnerVolumeSpecName "kube-api-access-vkkwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:58:23.654736 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.654720    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-podinfo" pod "fa9b9295-3acd-4cb9-8d87-32560888e3cf" (UID: "fa9b9295-3acd-4cb9-8d87-32560888e3cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:58:23.754478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.754450    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:23.754478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.754475    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:23.754478 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.754485    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkkwx\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-kube-api-access-vkkwx\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:23.754763 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.754496    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa9b9295-3acd-4cb9-8d87-32560888e3cf-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:23.779361 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.779330    5575 generic.go:356] "Generic (PLEG): container finished" podID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerID="bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966" exitCode=0
Oct 30 21:58:23.779843 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.779400    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"
Oct 30 21:58:23.779843 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.779420    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" event={"ID":"fa9b9295-3acd-4cb9-8d87-32560888e3cf","Type":"ContainerDied","Data":"bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966"}
Oct 30 21:58:23.779843 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.779473    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z" event={"ID":"fa9b9295-3acd-4cb9-8d87-32560888e3cf","Type":"ContainerDied","Data":"b5987ece5b799700d20385e6be8e77dc8786e60f152e85c9376d8d9a8fc91482"}
Oct 30 21:58:23.779843 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.779500    5575 scope.go:122] "RemoveContainer" containerID="bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966"
Oct 30 21:58:23.792763 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.792563    5575 scope.go:122] "RemoveContainer" containerID="e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922"
Oct 30 21:58:23.804091 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.804070    5575 scope.go:122] "RemoveContainer" containerID="bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966"
Oct 30 21:58:23.804388 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:58:23.804364    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966\": container with ID starting with bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966 not found: ID does not exist" containerID="bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966"
Oct 30 21:58:23.804480 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.804402    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966"} err="failed to get container status \"bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966\": rpc error: code = NotFound desc = could not find container \"bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966\": container with ID starting with bc5067af45edba8f026dbb61ae24ef843e5631de50c3e0a4ef40fb74956c3966 not found: ID does not exist"
Oct 30 21:58:23.804480 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.804425    5575 scope.go:122] "RemoveContainer" containerID="e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922"
Oct 30 21:58:23.804732 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:58:23.804714    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922\": container with ID starting with e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922 not found: ID does not exist" containerID="e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922"
Oct 30 21:58:23.804821 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.804736    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922"} err="failed to get container status \"e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922\": rpc error: code = NotFound desc = could not find container \"e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922\": container with ID starting with e024903341dc6a3bb96762f97896837ec2a00327cfc4685ad243f33096ea4922 not found: ID does not exist"
Oct 30 21:58:23.917026 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.916947    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"]
Oct 30 21:58:23.920728 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:23.920702    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-259e81-openshift-default-5b4fb6c495-qb44z"]
Oct 30 21:58:25.127872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:25.127838    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" path="/var/lib/kubelet/pods/fa9b9295-3acd-4cb9-8d87-32560888e3cf/volumes"
Oct 30 21:58:28.100739 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:28.100696    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:31.125213 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:31.125169    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:31.310590 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:31.310549    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:32.055192 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:32.055153    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:32.669503 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:32.669472    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:34.117751 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:34.117715    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:34.485948 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:34.485913    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:34.741290 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:34.741204    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:35.472017 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:35.471978    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:35.731900 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:35.731816    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:35.985606 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:35.985513    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:36.138956 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:36.138913    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:36.748545 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:36.748498    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:37.477919 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:37.477872    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:37.631887 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:37.631854    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:39.512655 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:39.512614    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:39.669168 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:39.669138    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:39.823731 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:39.823639    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:40.023804 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.023767    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:40.311954 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.311898    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:40.357298 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.357183    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"]
Oct 30 21:58:40.358785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.358760    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy"
Oct 30 21:58:40.358951 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.358936    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy"
Oct 30 21:58:40.360274 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.360258    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy"
Oct 30 21:58:40.360372 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.360361    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy"
Oct 30 21:58:40.360615 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.360604    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy"
Oct 30 21:58:40.367149 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.367129    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:40.428215 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.428176    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"]
Oct 30 21:58:40.490410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.490357    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcz82\" (UniqueName: \"kubernetes.io/projected/840f7e5a-4dca-4543-b75a-a6844d736985-kube-api-access-lcz82\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4\" (UID: \"840f7e5a-4dca-4543-b75a-a6844d736985\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:40.503681 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.503651    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/840f7e5a-4dca-4543-b75a-a6844d736985-plugins-config-volume\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4\" (UID: \"840f7e5a-4dca-4543-b75a-a6844d736985\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:40.504164 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.500897    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-71a3d788-dockercfg-dml7x\""
Oct 30 21:58:40.504327 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.500795    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-71a3d788\""
Oct 30 21:58:40.549489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.549458    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"]
Oct 30 21:58:40.551221 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.551191    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa9b9295-3acd-4cb9-8d87-32560888e3cf" containerName="istio-proxy"
Oct 30 21:58:40.555760 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.555743    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:40.589219 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.589189    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"]
Oct 30 21:58:40.606212 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.606176    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsszb\" (UniqueName: \"kubernetes.io/projected/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-kube-api-access-wsszb\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm\" (UID: \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:40.606376 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.606271    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcz82\" (UniqueName: \"kubernetes.io/projected/840f7e5a-4dca-4543-b75a-a6844d736985-kube-api-access-lcz82\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4\" (UID: \"840f7e5a-4dca-4543-b75a-a6844d736985\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:40.606453 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.606402    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm\" (UID: \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:40.606514 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.606466    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/840f7e5a-4dca-4543-b75a-a6844d736985-plugins-config-volume\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4\" (UID: \"840f7e5a-4dca-4543-b75a-a6844d736985\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:40.607476 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.607447    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/840f7e5a-4dca-4543-b75a-a6844d736985-plugins-config-volume\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4\" (UID: \"840f7e5a-4dca-4543-b75a-a6844d736985\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:40.668400 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.668370    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcz82\" (UniqueName: \"kubernetes.io/projected/840f7e5a-4dca-4543-b75a-a6844d736985-kube-api-access-lcz82\") pod \"payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4\" (UID: \"840f7e5a-4dca-4543-b75a-a6844d736985\") " pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:40.706276 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.706240    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:40.707886 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.707859    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm\" (UID: \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:40.708098 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.708082    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsszb\" (UniqueName: \"kubernetes.io/projected/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-kube-api-access-wsszb\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm\" (UID: \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:40.708796 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.708766    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm\" (UID: \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:40.746953 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.746924    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:40.771559 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.771528    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsszb\" (UniqueName: \"kubernetes.io/projected/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-kube-api-access-wsszb\") pod \"payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm\" (UID: \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:40.875134 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:40.874223    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:41.164163 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:41.164120    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"]
Oct 30 21:58:41.305392 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:41.305361    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"]
Oct 30 21:58:41.305611 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:58:41.305588    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eefa3b9_f854_4f44_9f60_a1fec407dfb5.slice/crio-bda7c72d279022edd67b2f26566175cb6fad49052edeabf3d69c147840736122 WatchSource:0}: Error finding container bda7c72d279022edd67b2f26566175cb6fad49052edeabf3d69c147840736122: Status 404 returned error can't find the container with id bda7c72d279022edd67b2f26566175cb6fad49052edeabf3d69c147840736122
Oct 30 21:58:42.039665 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.039628    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4" event={"ID":"840f7e5a-4dca-4543-b75a-a6844d736985","Type":"ContainerStarted","Data":"79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947"}
Oct 30 21:58:42.040138 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.039702    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:42.040138 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.039731    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4" event={"ID":"840f7e5a-4dca-4543-b75a-a6844d736985","Type":"ContainerStarted","Data":"965ad4329946b55acca2f7665763973258c78a4832dc39fff7b04436dbd87edd"}
Oct 30 21:58:42.041513 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.041486    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm" event={"ID":"2eefa3b9-f854-4f44-9f60-a1fec407dfb5","Type":"ContainerStarted","Data":"b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818"}
Oct 30 21:58:42.041645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.041532    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm" event={"ID":"2eefa3b9-f854-4f44-9f60-a1fec407dfb5","Type":"ContainerStarted","Data":"bda7c72d279022edd67b2f26566175cb6fad49052edeabf3d69c147840736122"}
Oct 30 21:58:42.041645 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.041581    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:42.206443 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.206369    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4" podStartSLOduration=2.206351029 podStartE2EDuration="2.206351029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:42.157145059 +0000 UTC m=+2123.188993594" watchObservedRunningTime="2026-10-30 21:58:42.206351029 +0000 UTC m=+2123.238199593"
Oct 30 21:58:42.277030 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.276926    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm" podStartSLOduration=2.276910598 podStartE2EDuration="2.276910598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:42.273835452 +0000 UTC m=+2123.305683988" watchObservedRunningTime="2026-10-30 21:58:42.276910598 +0000 UTC m=+2123.308759134"
Oct 30 21:58:42.441187 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.441144    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:42.775513 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.775437    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:42.951707 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:42.951671    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:43.190032 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:43.190005    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:43.425989 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:43.425885    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:43.738770 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:43.738714    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:43.888587 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:43.888552    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:44.099106 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:44.099018    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:46.139371 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.139324    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:46.295577 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.295542    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:46.741718 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.741679    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"]
Oct 30 21:58:46.747050 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.747023    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.872990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.868292    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8c5350-openshift-default-dockercfg-pvcwv\""
Oct 30 21:58:46.902990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.886069    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-data\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.902990 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.892040    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-certs\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.904166 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.903276    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-podinfo\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.916368 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.916159    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-token\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.939630 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.939600    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2wwq\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-kube-api-access-p2wwq\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.940072 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.939900    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-envoy\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.940436 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.940414    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-credential-socket\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.966496 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.966448    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c0d99c-0998-48b5-9367-ef699d3608c7-istiod-ca-cert\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.967042 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.967017    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-socket\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:46.996354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:46.996191    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:47.034079 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.034043    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"]
Oct 30 21:58:47.075824 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.075795    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-socket\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076022 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.075844    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-data\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076022 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.075875    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-certs\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076022 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.075897    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-podinfo\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076022 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.075947    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-token\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.076045    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2wwq\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-kube-api-access-p2wwq\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.076071    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-envoy\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076260 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.076145    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-credential-socket\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.076262    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c0d99c-0998-48b5-9367-ef699d3608c7-istiod-ca-cert\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.076298    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-socket\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.076320    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-data\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076431 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.076372    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-certs\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076638 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.076595    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-credential-socket\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.076887 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.076866    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c0d99c-0998-48b5-9367-ef699d3608c7-istiod-ca-cert\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.078676 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.078645    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-envoy\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.078776 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.078710    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-podinfo\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.138452 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.138424    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-token\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.138660 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.138560    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2wwq\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-kube-api-access-p2wwq\") pod \"e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") " pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.188040 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.187959    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:47.379618 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.379530    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:47.818871 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.818841    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"]
Oct 30 21:58:47.820752 ip-10-0-136-135 kubenswrapper[5575]: W1030 21:58:47.820725    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c0d99c_0998_48b5_9367_ef699d3608c7.slice/crio-c255feddc2c04ec610aa65357c3a1509ddcd6790e9b4f79c1eb8d39716ef8841 WatchSource:0}: Error finding container c255feddc2c04ec610aa65357c3a1509ddcd6790e9b4f79c1eb8d39716ef8841: Status 404 returned error can't find the container with id c255feddc2c04ec610aa65357c3a1509ddcd6790e9b4f79c1eb8d39716ef8841
Oct 30 21:58:47.823869 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.823838    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:47.824009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.823901    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:47.824009 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:47.823930    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:48.069415 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:48.069333    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:48.096540 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:48.096495    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" event={"ID":"61c0d99c-0998-48b5-9367-ef699d3608c7","Type":"ContainerStarted","Data":"0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf"}
Oct 30 21:58:48.111198 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:48.096616    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" event={"ID":"61c0d99c-0998-48b5-9367-ef699d3608c7","Type":"ContainerStarted","Data":"c255feddc2c04ec610aa65357c3a1509ddcd6790e9b4f79c1eb8d39716ef8841"}
Oct 30 21:58:48.223061 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:48.222000    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" podStartSLOduration=2.221981414 podStartE2EDuration="2.221981414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:48.219766549 +0000 UTC m=+2129.251615085" watchObservedRunningTime="2026-10-30 21:58:48.221981414 +0000 UTC m=+2129.253829947"
Oct 30 21:58:48.380582 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:48.380480    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:48.387999 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:48.387942    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:49.104825 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:49.104789    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:49.105897 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:49.105873    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 21:58:50.178992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:50.178802    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:50.330419 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:50.330386    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:50.525532 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:50.525462    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:53.097992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:53.087522    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:53.097992 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:53.097815    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 21:58:53.114998 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:53.114187    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 21:58:53.309785 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:53.302808    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:53.516005 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:58:53.515407    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:58:56.067807 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:56.067768    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:56.225738 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:56.225695    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:57.552002 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:57.550931    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:59.379772 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:58:59.379717    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:01.099619 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:01.099587    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:01.265877 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:01.265844    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:01.418423 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:01.418392    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:04.613932 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:04.613893    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:04.902071 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:04.902037    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:05.104225 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:05.104183    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:09.998450 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:09.998417    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:10.240945 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:10.240914    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:10.401500 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:10.401461    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:13.627901 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:13.627865    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:13.791399 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:13.788062    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:15.768110 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:15.768063    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:20.076092 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:20.076058    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:20.294178 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:20.294086    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:21.079872 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:21.079832    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:23.487999 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:59:23.487917    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:59:25.392128 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.392095    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"]
Oct 30 21:59:25.392567 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.392310    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr" podUID="b38533f7-6287-49e6-a2fb-bb2a26e693d4" containerName="maas-api" containerID="cri-o://cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb" gracePeriod=30
Oct 30 21:59:25.504564 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.504515    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:25.710580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.710546    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:59:25.886802 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.886767    5575 generic.go:356] "Generic (PLEG): container finished" podID="b38533f7-6287-49e6-a2fb-bb2a26e693d4" containerID="cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb" exitCode=0
Oct 30 21:59:25.887015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.886919    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr" event={"ID":"b38533f7-6287-49e6-a2fb-bb2a26e693d4","Type":"ContainerDied","Data":"cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb"}
Oct 30 21:59:25.887015 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.887006    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr" event={"ID":"b38533f7-6287-49e6-a2fb-bb2a26e693d4","Type":"ContainerDied","Data":"04c758f3f2050d1c9b3e4a6c40d445217621333c321ea05426e1f29d1162d009"}
Oct 30 21:59:25.887125 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.887041    5575 scope.go:122] "RemoveContainer" containerID="cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb"
Oct 30 21:59:25.887212 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.887201    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"
Oct 30 21:59:25.898026 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.898000    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b38533f7-6287-49e6-a2fb-bb2a26e693d4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38533f7-6287-49e6-a2fb-bb2a26e693d4-openshift-service-ca\") pod \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") "
Oct 30 21:59:25.898324 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.898307    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls\") pod \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") "
Oct 30 21:59:25.898428 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.898418    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b38533f7-6287-49e6-a2fb-bb2a26e693d4-kube-api-access-7j569\" (UniqueName: \"kubernetes.io/projected/b38533f7-6287-49e6-a2fb-bb2a26e693d4-kube-api-access-7j569\") pod \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") "
Oct 30 21:59:25.898537 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.898312    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b38533f7-6287-49e6-a2fb-bb2a26e693d4-openshift-service-ca" pod "b38533f7-6287-49e6-a2fb-bb2a26e693d4" (UID: "b38533f7-6287-49e6-a2fb-bb2a26e693d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:59:25.898702 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.898520    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-metrics-certs\") pod \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\" (UID: \"b38533f7-6287-49e6-a2fb-bb2a26e693d4\") "
Oct 30 21:59:25.899651 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.899631    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38533f7-6287-49e6-a2fb-bb2a26e693d4-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:25.900599 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.900577    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-metrics-certs" pod "b38533f7-6287-49e6-a2fb-bb2a26e693d4" (UID: "b38533f7-6287-49e6-a2fb-bb2a26e693d4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:59:25.901156 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.901125    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b38533f7-6287-49e6-a2fb-bb2a26e693d4-kube-api-access-7j569" pod "b38533f7-6287-49e6-a2fb-bb2a26e693d4" (UID: "b38533f7-6287-49e6-a2fb-bb2a26e693d4"). InnerVolumeSpecName "kube-api-access-7j569". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:59:25.902113 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.902089    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls" pod "b38533f7-6287-49e6-a2fb-bb2a26e693d4" (UID: "b38533f7-6287-49e6-a2fb-bb2a26e693d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:59:25.911097 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.911001    5575 scope.go:122] "RemoveContainer" containerID="cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb"
Oct 30 21:59:25.911386 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:59:25.911369    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb\": container with ID starting with cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb not found: ID does not exist" containerID="cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb"
Oct 30 21:59:25.911505 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:25.911483    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb"} err="failed to get container status \"cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb\": rpc error: code = NotFound desc = could not find container \"cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb\": container with ID starting with cad28c6c9e13024df944a285da20dc59c0fde17b451e267936d3527410ab9aeb not found: ID does not exist"
Oct 30 21:59:26.000881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:26.000799    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:26.000881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:26.000834    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j569\" (UniqueName: \"kubernetes.io/projected/b38533f7-6287-49e6-a2fb-bb2a26e693d4-kube-api-access-7j569\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:26.000881 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:26.000845    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b38533f7-6287-49e6-a2fb-bb2a26e693d4-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:26.311323 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:26.311208    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"]
Oct 30 21:59:26.316832 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:26.316804    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bd3c59-6887bbfbcc-tspkr"]
Oct 30 21:59:27.061314 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:27.061279    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:27.132580 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:27.132544    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b38533f7-6287-49e6-a2fb-bb2a26e693d4" path="/var/lib/kubelet/pods/b38533f7-6287-49e6-a2fb-bb2a26e693d4/volumes"
Oct 30 21:59:27.353913 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:27.353803    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:27.546373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:27.546337    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:32.521850 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:32.521755    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:34.021489 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:34.021447    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:34.172221 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:34.172186    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:37.408631 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:37.408587    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:42.129065 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:42.129032    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"]
Oct 30 21:59:42.129507 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:42.129273    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy" containerID="cri-o://097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0" gracePeriod=30
Oct 30 21:59:42.278185 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:42.278144    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:43.822893 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:43.822851    5575 patch_prober.go:29] interesting pod/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:59:43.823327 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:43.822914    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:59:44.361417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:44.361380    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:44.519373 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:44.519297    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:47.074204 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.074172    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:47.411950 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.411922    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:59:47.515545 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515519    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-credential-socket\") pod \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") "
Oct 30 21:59:47.515695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515585    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-data\") pod \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") "
Oct 30 21:59:47.515695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515605    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-kube-api-access-thblw\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-kube-api-access-thblw\") pod \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") "
Oct 30 21:59:47.515695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515634    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-socket\") pod \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") "
Oct 30 21:59:47.515695 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515691    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istiod-ca-cert\") pod \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") "
Oct 30 21:59:47.515930 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515768    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-envoy\") pod \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") "
Oct 30 21:59:47.515930 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515792    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-credential-socket" pod "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" (UID: "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:47.515930 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515821    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-podinfo\") pod \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") "
Oct 30 21:59:47.515930 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515862    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-token\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-token\") pod \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") "
Oct 30 21:59:47.515930 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515903    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-certs\") pod \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\" (UID: \"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2\") "
Oct 30 21:59:47.516213 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.515859    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-data" pod "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" (UID: "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:47.516213 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.516039    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-socket" pod "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" (UID: "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:47.516213 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.516142    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istiod-ca-cert" pod "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" (UID: "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:59:47.516410 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.516345    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-certs" pod "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" (UID: "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:47.516835 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.516812    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:47.516935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.516840    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:47.516935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.516858    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:47.516935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.516872    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:47.516935 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.516885    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:47.518205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.518183    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-podinfo" pod "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" (UID: "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:59:47.518205 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.518209    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-token" pod "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" (UID: "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:59:47.518354 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.518243    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-kube-api-access-thblw" pod "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" (UID: "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2"). InnerVolumeSpecName "kube-api-access-thblw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:59:47.518418 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.518393    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-envoy" pod "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" (UID: "4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:47.618295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.618254    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:47.618295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.618284    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:47.618295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.618293    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:47.618295 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:47.618303    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thblw\" (UniqueName: \"kubernetes.io/projected/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2-kube-api-access-thblw\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:48.020167 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.020129    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:48.128931 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.128902    5575 generic.go:356] "Generic (PLEG): container finished" podID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerID="097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0" exitCode=0
Oct 30 21:59:48.129417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.128953    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"
Oct 30 21:59:48.129417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.129015    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" event={"ID":"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2","Type":"ContainerDied","Data":"097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0"}
Oct 30 21:59:48.129417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.129083    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq" event={"ID":"4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2","Type":"ContainerDied","Data":"de50e3fd0238a79c8e31c47fb74639eb4507e6681d5190ebca0ec9e1fdaf3b5e"}
Oct 30 21:59:48.129417 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.129118    5575 scope.go:122] "RemoveContainer" containerID="097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0"
Oct 30 21:59:48.142130 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.142080    5575 scope.go:122] "RemoveContainer" containerID="10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda"
Oct 30 21:59:48.152848 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.152827    5575 scope.go:122] "RemoveContainer" containerID="097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0"
Oct 30 21:59:48.153157 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:59:48.153141    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0\": container with ID starting with 097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0 not found: ID does not exist" containerID="097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0"
Oct 30 21:59:48.153232 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.153165    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0"} err="failed to get container status \"097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0\": rpc error: code = NotFound desc = could not find container \"097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0\": container with ID starting with 097828a65f6938967cc72e10a225b9a6bd20ce814dce0dc454662f5a31f7d3d0 not found: ID does not exist"
Oct 30 21:59:48.153232 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.153183    5575 scope.go:122] "RemoveContainer" containerID="10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda"
Oct 30 21:59:48.153415 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:59:48.153401    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda\": container with ID starting with 10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda not found: ID does not exist" containerID="10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda"
Oct 30 21:59:48.153459 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.153420    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda"} err="failed to get container status \"10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda\": rpc error: code = NotFound desc = could not find container \"10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda\": container with ID starting with 10b6a7fe1cd575823235f2565fdb1d58587fe40556494a7e97440365cd5d0cda not found: ID does not exist"
Oct 30 21:59:48.296842 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.296770    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"]
Oct 30 21:59:48.346263 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:48.346225    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w2pqq"]
Oct 30 21:59:49.129035 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:49.129003    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" path="/var/lib/kubelet/pods/4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2/volumes"
Oct 30 21:59:51.939246 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:51.939204    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:53.404851 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:53.404809    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:53.491195 ip-10-0-136-135 kubenswrapper[5575]: E1030 21:59:53.491160    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 21:59:54.404363 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:54.404328    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:54.559572 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:54.559536    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:54.742036 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:54.741951    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"]
Oct 30 21:59:54.742245 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:54.742220    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy" containerID="cri-o://b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d" gracePeriod=30
Oct 30 21:59:54.752427 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:54.752405    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:55.781315 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:55.781277    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:55.983592 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:55.983561    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:56.190662 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:56.190633    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:57.742067 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:57.742035    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:57.993502 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:57.993387    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:58.143078 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:58.143039    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:58.718175 ip-10-0-136-135 kubenswrapper[5575]: I1030 21:59:58.718144    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:00.042868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.042832    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 22:00:00.141481 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.141445    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-kube-api-access-4w2f8\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-kube-api-access-4w2f8\") pod \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") "
Oct 30 22:00:00.141687 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.141530    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-certs\") pod \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") "
Oct 30 22:00:00.141760 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.141689    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-token\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-token\") pod \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") "
Oct 30 22:00:00.141760 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.141731    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-credential-socket\") pod \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") "
Oct 30 22:00:00.141870 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.141781    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istiod-ca-cert\") pod \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") "
Oct 30 22:00:00.141870 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.141846    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-certs" pod "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" (UID: "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:00.142055 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.141859    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-envoy\") pod \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") "
Oct 30 22:00:00.142055 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.141937    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-podinfo\") pod \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") "
Oct 30 22:00:00.142055 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.142026    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-socket\") pod \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") "
Oct 30 22:00:00.142217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.142065    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-credential-socket" pod "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" (UID: "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:00.142217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.142071    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-data\") pod \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\" (UID: \"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40\") "
Oct 30 22:00:00.142337 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.142229    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-data" pod "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" (UID: "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:00.142778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.142754    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istiod-ca-cert" pod "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" (UID: "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:00.143193 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.142910    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-socket" pod "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" (UID: "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:00.143340 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.142799    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:00.143340 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.143337    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:00.143535 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.143360    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:00.144268 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.144245    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-envoy" pod "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" (UID: "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:00.144555 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.144531    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-kube-api-access-4w2f8" pod "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" (UID: "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40"). InnerVolumeSpecName "kube-api-access-4w2f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:00.144720 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.144698    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-token" pod "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" (UID: "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:00.144942 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.144907    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-podinfo" pod "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" (UID: "2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:00:00.203541 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.203500    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"]
Oct 30 22:00:00.204231 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204214    5575 cpu_manager.go:414] "containerMap: removing container" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy"
Oct 30 22:00:00.204231 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204231    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy"
Oct 30 22:00:00.204391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204246    5575 cpu_manager.go:414] "containerMap: removing container" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy"
Oct 30 22:00:00.204391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204252    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy"
Oct 30 22:00:00.204391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204259    5575 cpu_manager.go:414] "containerMap: removing container" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy"
Oct 30 22:00:00.204391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204264    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy"
Oct 30 22:00:00.204391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204275    5575 cpu_manager.go:414] "containerMap: removing container" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy"
Oct 30 22:00:00.204391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204279    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy"
Oct 30 22:00:00.204391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204295    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b38533f7-6287-49e6-a2fb-bb2a26e693d4" containerName="maas-api"
Oct 30 22:00:00.204391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204299    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b38533f7-6287-49e6-a2fb-bb2a26e693d4" containerName="maas-api"
Oct 30 22:00:00.204790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204411    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b38533f7-6287-49e6-a2fb-bb2a26e693d4" containerName="maas-api"
Oct 30 22:00:00.204790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204425    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy"
Oct 30 22:00:00.204790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204432    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f2acbf1-7aa1-41ec-ba84-7338e4ebc6d2" containerName="istio-proxy"
Oct 30 22:00:00.204790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204438    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy"
Oct 30 22:00:00.204790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.204445    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerName="istio-proxy"
Oct 30 22:00:00.208996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.208266    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"]
Oct 30 22:00:00.209224 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.209200    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:00.212910 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.212892    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:00.223573 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.223546    5575 generic.go:356] "Generic (PLEG): container finished" podID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" containerID="b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d" exitCode=0
Oct 30 22:00:00.223669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.223590    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" event={"ID":"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40","Type":"ContainerDied","Data":"b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d"}
Oct 30 22:00:00.223669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.223595    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"
Oct 30 22:00:00.223669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.223640    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt" event={"ID":"2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40","Type":"ContainerDied","Data":"6d3c83d6178b2260106bab72a110882a0126e6220b1589a05fcf4a9a41fa7814"}
Oct 30 22:00:00.223790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.223670    5575 scope.go:122] "RemoveContainer" containerID="b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d"
Oct 30 22:00:00.236476 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.236451    5575 scope.go:122] "RemoveContainer" containerID="f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4"
Oct 30 22:00:00.244334 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.244311    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:00.244429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.244337    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:00.244429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.244352    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:00.244429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.244365    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:00.244429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.244379    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:00.244429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.244392    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w2f8\" (UniqueName: \"kubernetes.io/projected/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40-kube-api-access-4w2f8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:00.247340 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.247323    5575 scope.go:122] "RemoveContainer" containerID="b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d"
Oct 30 22:00:00.247645 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:00.247610    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d\": container with ID starting with b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d not found: ID does not exist" containerID="b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d"
Oct 30 22:00:00.247707 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.247645    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d"} err="failed to get container status \"b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d\": rpc error: code = NotFound desc = could not find container \"b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d\": container with ID starting with b52424f4b5a91720b1e3635aa1640e9c36c793e8ae6e9f624289b7a4d2932b4d not found: ID does not exist"
Oct 30 22:00:00.247707 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.247666    5575 scope.go:122] "RemoveContainer" containerID="f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4"
Oct 30 22:00:00.247916 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:00.247900    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4\": container with ID starting with f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4 not found: ID does not exist" containerID="f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4"
Oct 30 22:00:00.247956 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.247920    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4"} err="failed to get container status \"f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4\": rpc error: code = NotFound desc = could not find container \"f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4\": container with ID starting with f8557a0d1238607947bae452c37490205a2b25f1d938f41c17ddce63a58771e4 not found: ID does not exist"
Oct 30 22:00:00.261469 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.261438    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"]
Oct 30 22:00:00.268430 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.268373    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:00.331826 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.331794    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:00:00.332032 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.331846    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"]
Oct 30 22:00:00.336650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.336623    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"]
Oct 30 22:00:00.345729 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.345698    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41181fce-e504-46b5-98bf-e04e89946a69-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn\" (UID: \"41181fce-e504-46b5-98bf-e04e89946a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:00.345933 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.345911    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjbzb\" (UniqueName: \"kubernetes.io/projected/41181fce-e504-46b5-98bf-e04e89946a69-kube-api-access-wjbzb\") pod \"maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn\" (UID: \"41181fce-e504-46b5-98bf-e04e89946a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:00.346209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.346190    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2trh\" (UniqueName: \"kubernetes.io/projected/085a757a-a7ac-40c3-ae9d-79022c4ec250-kube-api-access-g2trh\") pod \"maas-api-key-cleanup-29889960-p9cpc\" (UID: \"085a757a-a7ac-40c3-ae9d-79022c4ec250\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:00.346321 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.346308    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/085a757a-a7ac-40c3-ae9d-79022c4ec250-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889960-p9cpc\" (UID: \"085a757a-a7ac-40c3-ae9d-79022c4ec250\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:00.346456 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.346440    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq2xp\" (UniqueName: \"kubernetes.io/projected/b1db47cf-056c-43e2-a165-2f758c98f32a-kube-api-access-kq2xp\") pod \"maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h\" (UID: \"b1db47cf-056c-43e2-a165-2f758c98f32a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:00.346578 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.346565    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1db47cf-056c-43e2-a165-2f758c98f32a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h\" (UID: \"b1db47cf-056c-43e2-a165-2f758c98f32a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:00.376340 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.375933    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"]
Oct 30 22:00:00.447848 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.447811    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2trh\" (UniqueName: \"kubernetes.io/projected/085a757a-a7ac-40c3-ae9d-79022c4ec250-kube-api-access-g2trh\") pod \"maas-api-key-cleanup-29889960-p9cpc\" (UID: \"085a757a-a7ac-40c3-ae9d-79022c4ec250\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:00.448043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.447856    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/085a757a-a7ac-40c3-ae9d-79022c4ec250-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889960-p9cpc\" (UID: \"085a757a-a7ac-40c3-ae9d-79022c4ec250\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:00.448043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.447922    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq2xp\" (UniqueName: \"kubernetes.io/projected/b1db47cf-056c-43e2-a165-2f758c98f32a-kube-api-access-kq2xp\") pod \"maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h\" (UID: \"b1db47cf-056c-43e2-a165-2f758c98f32a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:00.448043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.447989    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1db47cf-056c-43e2-a165-2f758c98f32a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h\" (UID: \"b1db47cf-056c-43e2-a165-2f758c98f32a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:00.448234 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.448138    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41181fce-e504-46b5-98bf-e04e89946a69-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn\" (UID: \"41181fce-e504-46b5-98bf-e04e89946a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:00.448234 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.448173    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjbzb\" (UniqueName: \"kubernetes.io/projected/41181fce-e504-46b5-98bf-e04e89946a69-kube-api-access-wjbzb\") pod \"maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn\" (UID: \"41181fce-e504-46b5-98bf-e04e89946a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:00.448781 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.448754    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/085a757a-a7ac-40c3-ae9d-79022c4ec250-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889960-p9cpc\" (UID: \"085a757a-a7ac-40c3-ae9d-79022c4ec250\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:00.448833 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.448792    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41181fce-e504-46b5-98bf-e04e89946a69-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn\" (UID: \"41181fce-e504-46b5-98bf-e04e89946a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:00.448833 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.448819    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1db47cf-056c-43e2-a165-2f758c98f32a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h\" (UID: \"b1db47cf-056c-43e2-a165-2f758c98f32a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:00.509368 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.509339    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2trh\" (UniqueName: \"kubernetes.io/projected/085a757a-a7ac-40c3-ae9d-79022c4ec250-kube-api-access-g2trh\") pod \"maas-api-key-cleanup-29889960-p9cpc\" (UID: \"085a757a-a7ac-40c3-ae9d-79022c4ec250\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:00.509749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.509725    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjbzb\" (UniqueName: \"kubernetes.io/projected/41181fce-e504-46b5-98bf-e04e89946a69-kube-api-access-wjbzb\") pod \"maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn\" (UID: \"41181fce-e504-46b5-98bf-e04e89946a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:00.509800 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.509725    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq2xp\" (UniqueName: \"kubernetes.io/projected/b1db47cf-056c-43e2-a165-2f758c98f32a-kube-api-access-kq2xp\") pod \"maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h\" (UID: \"b1db47cf-056c-43e2-a165-2f758c98f32a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:00.529736 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.529680    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:00.540140 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.540116    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:00.572928 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.572898    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"]
Oct 30 22:00:00.578487 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.578461    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bd3c59-openshift-default-7ffc8ffcdf-9shpt"]
Oct 30 22:00:00.588143 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.588119    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:00.920290 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.920261    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"]
Oct 30 22:00:00.920817 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:00:00.920789    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41181fce_e504_46b5_98bf_e04e89946a69.slice/crio-52a7ecdbb8437dedcc3f800d4f0466c1b8451fb5aadb341c2331a10c0c8b9bbc WatchSource:0}: Error finding container 52a7ecdbb8437dedcc3f800d4f0466c1b8451fb5aadb341c2331a10c0c8b9bbc: Status 404 returned error can't find the container with id 52a7ecdbb8437dedcc3f800d4f0466c1b8451fb5aadb341c2331a10c0c8b9bbc
Oct 30 22:00:00.971011 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:00:00.970949    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085a757a_a7ac_40c3_ae9d_79022c4ec250.slice/crio-907144ea9c4f470873a4745a9767b82f758ebd01ad1de4245733361006ce34b4 WatchSource:0}: Error finding container 907144ea9c4f470873a4745a9767b82f758ebd01ad1de4245733361006ce34b4: Status 404 returned error can't find the container with id 907144ea9c4f470873a4745a9767b82f758ebd01ad1de4245733361006ce34b4
Oct 30 22:00:00.971383 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:00.971360    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"]
Oct 30 22:00:01.027226 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:01.027203    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"]
Oct 30 22:00:01.027360 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:00:01.027333    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1db47cf_056c_43e2_a165_2f758c98f32a.slice/crio-d7cf1788b21e6c2e0846d76cf62c8d828da59690729f6be1e37dc5f0166268b7 WatchSource:0}: Error finding container d7cf1788b21e6c2e0846d76cf62c8d828da59690729f6be1e37dc5f0166268b7: Status 404 returned error can't find the container with id d7cf1788b21e6c2e0846d76cf62c8d828da59690729f6be1e37dc5f0166268b7
Oct 30 22:00:01.129281 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:01.129249    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40" path="/var/lib/kubelet/pods/2aef7d63-7ca7-4ff7-b4f8-0ce318b5ff40/volumes"
Oct 30 22:00:01.234152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:01.234120    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" event={"ID":"b1db47cf-056c-43e2-a165-2f758c98f32a","Type":"ContainerStarted","Data":"d7cf1788b21e6c2e0846d76cf62c8d828da59690729f6be1e37dc5f0166268b7"}
Oct 30 22:00:01.235605 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:01.235580    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" event={"ID":"085a757a-a7ac-40c3-ae9d-79022c4ec250","Type":"ContainerStarted","Data":"907144ea9c4f470873a4745a9767b82f758ebd01ad1de4245733361006ce34b4"}
Oct 30 22:00:01.237532 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:01.237505    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" event={"ID":"41181fce-e504-46b5-98bf-e04e89946a69","Type":"ContainerStarted","Data":"a7c7e717f75d497406b0ecef96e9aad501745824412aa723e85b7333d4816f8e"}
Oct 30 22:00:01.237637 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:01.237555    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" event={"ID":"41181fce-e504-46b5-98bf-e04e89946a69","Type":"ContainerStarted","Data":"52a7ecdbb8437dedcc3f800d4f0466c1b8451fb5aadb341c2331a10c0c8b9bbc"}
Oct 30 22:00:01.356911 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:01.356865    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" podStartSLOduration=1.356851526 podStartE2EDuration="1.356851526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:01.351942939 +0000 UTC m=+2202.383791468" watchObservedRunningTime="2026-10-30 22:00:01.356851526 +0000 UTC m=+2202.388700060"
Oct 30 22:00:02.248392 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:02.248358    5575 generic.go:356] "Generic (PLEG): container finished" podID="41181fce-e504-46b5-98bf-e04e89946a69" containerID="a7c7e717f75d497406b0ecef96e9aad501745824412aa723e85b7333d4816f8e" exitCode=60
Oct 30 22:00:02.248926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:02.248545    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" event={"ID":"41181fce-e504-46b5-98bf-e04e89946a69","Type":"ContainerDied","Data":"a7c7e717f75d497406b0ecef96e9aad501745824412aa723e85b7333d4816f8e"}
Oct 30 22:00:02.249105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:02.248726    5575 scope.go:122] "RemoveContainer" containerID="a7c7e717f75d497406b0ecef96e9aad501745824412aa723e85b7333d4816f8e"
Oct 30 22:00:02.250924 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:02.250900    5575 generic.go:356] "Generic (PLEG): container finished" podID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerID="c804dcf307e7d6975ef4b48502eef3ce38b8d1f352f354948307c4e6cf6aef50" exitCode=60
Oct 30 22:00:02.251044 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:02.251020    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" event={"ID":"b1db47cf-056c-43e2-a165-2f758c98f32a","Type":"ContainerDied","Data":"c804dcf307e7d6975ef4b48502eef3ce38b8d1f352f354948307c4e6cf6aef50"}
Oct 30 22:00:02.251297 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:02.251276    5575 scope.go:122] "RemoveContainer" containerID="c804dcf307e7d6975ef4b48502eef3ce38b8d1f352f354948307c4e6cf6aef50"
Oct 30 22:00:02.255308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:02.255284    5575 generic.go:356] "Generic (PLEG): container finished" podID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerID="b9ed488b3ad588e35bcbde4fb43c6d488668cdfbffde3ac33010a963a4f362c3" exitCode=60
Oct 30 22:00:02.255407 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:02.255316    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" event={"ID":"085a757a-a7ac-40c3-ae9d-79022c4ec250","Type":"ContainerDied","Data":"b9ed488b3ad588e35bcbde4fb43c6d488668cdfbffde3ac33010a963a4f362c3"}
Oct 30 22:00:02.255618 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:02.255599    5575 scope.go:122] "RemoveContainer" containerID="b9ed488b3ad588e35bcbde4fb43c6d488668cdfbffde3ac33010a963a4f362c3"
Oct 30 22:00:03.264952 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:03.264919    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" event={"ID":"b1db47cf-056c-43e2-a165-2f758c98f32a","Type":"ContainerStarted","Data":"9739da7e147ece5c228eb7f620c093fb137db9d9cc115fb6d774fc4ad641653f"}
Oct 30 22:00:03.266877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:03.266848    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" event={"ID":"085a757a-a7ac-40c3-ae9d-79022c4ec250","Type":"ContainerStarted","Data":"8cbbef9e459068c9f2f21ecc0a68bd00287af3de927f2e7b47dfe1f2ed3a058f"}
Oct 30 22:00:03.268801 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:03.268776    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" event={"ID":"41181fce-e504-46b5-98bf-e04e89946a69","Type":"ContainerStarted","Data":"fa828728ac5e7f290af98bd9da0cc47d35b7c08ac5bae2667dfd3a292ee69c63"}
Oct 30 22:00:03.384505 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:03.384459    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" podStartSLOduration=3.384445537 podStartE2EDuration="3.384445537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:03.380402823 +0000 UTC m=+2204.412251368" watchObservedRunningTime="2026-10-30 22:00:03.384445537 +0000 UTC m=+2204.416294072"
Oct 30 22:00:03.499346 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:03.499300    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" podStartSLOduration=3.499285787 podStartE2EDuration="3.499285787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:03.49639861 +0000 UTC m=+2204.528247157" watchObservedRunningTime="2026-10-30 22:00:03.499285787 +0000 UTC m=+2204.531134369"
Oct 30 22:00:04.015875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.015712    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"]
Oct 30 22:00:04.021265 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.021240    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.066092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.066057    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:04.074140 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.074115    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-8c5350-serving-cert\""
Oct 30 22:00:04.078726 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.078699    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"]
Oct 30 22:00:04.199948 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.199920    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.200156 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.199984    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a31690a-328d-4349-8387-26e9dced072c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.200224 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.200198    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8mvt\" (UniqueName: \"kubernetes.io/projected/4a31690a-328d-4349-8387-26e9dced072c-kube-api-access-b8mvt\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.200305 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.200292    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-metrics-certs\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.225118 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.225088    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:04.309083 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.301737    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.309083 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.301837    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a31690a-328d-4349-8387-26e9dced072c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.309083 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.302117    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8mvt\" (UniqueName: \"kubernetes.io/projected/4a31690a-328d-4349-8387-26e9dced072c-kube-api-access-b8mvt\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.309083 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.302259    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-metrics-certs\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.309083 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.305019    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a31690a-328d-4349-8387-26e9dced072c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.309083 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.307659    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-metrics-certs\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.313392 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.313364    5575 generic.go:356] "Generic (PLEG): container finished" podID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerID="9739da7e147ece5c228eb7f620c093fb137db9d9cc115fb6d774fc4ad641653f" exitCode=60
Oct 30 22:00:04.313547 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.313483    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" event={"ID":"b1db47cf-056c-43e2-a165-2f758c98f32a","Type":"ContainerDied","Data":"9739da7e147ece5c228eb7f620c093fb137db9d9cc115fb6d774fc4ad641653f"}
Oct 30 22:00:04.313547 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.313537    5575 scope.go:122] "RemoveContainer" containerID="c804dcf307e7d6975ef4b48502eef3ce38b8d1f352f354948307c4e6cf6aef50"
Oct 30 22:00:04.315198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.315160    5575 scope.go:122] "RemoveContainer" containerID="9739da7e147ece5c228eb7f620c093fb137db9d9cc115fb6d774fc4ad641653f"
Oct 30 22:00:04.315560 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:04.315532    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h_odh-ai-gateway-infra(b1db47cf-056c-43e2-a165-2f758c98f32a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a"
Oct 30 22:00:04.317766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.317405    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.320624 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.319935    5575 generic.go:356] "Generic (PLEG): container finished" podID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerID="8cbbef9e459068c9f2f21ecc0a68bd00287af3de927f2e7b47dfe1f2ed3a058f" exitCode=60
Oct 30 22:00:04.320624 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.320140    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" event={"ID":"085a757a-a7ac-40c3-ae9d-79022c4ec250","Type":"ContainerDied","Data":"8cbbef9e459068c9f2f21ecc0a68bd00287af3de927f2e7b47dfe1f2ed3a058f"}
Oct 30 22:00:04.320624 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.320447    5575 scope.go:122] "RemoveContainer" containerID="8cbbef9e459068c9f2f21ecc0a68bd00287af3de927f2e7b47dfe1f2ed3a058f"
Oct 30 22:00:04.320887 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:04.320706    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889960-p9cpc_odh-ai-gateway-infra(085a757a-a7ac-40c3-ae9d-79022c4ec250)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250"
Oct 30 22:00:04.323161 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.323131    5575 generic.go:356] "Generic (PLEG): container finished" podID="41181fce-e504-46b5-98bf-e04e89946a69" containerID="fa828728ac5e7f290af98bd9da0cc47d35b7c08ac5bae2667dfd3a292ee69c63" exitCode=60
Oct 30 22:00:04.323249 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.323206    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" event={"ID":"41181fce-e504-46b5-98bf-e04e89946a69","Type":"ContainerDied","Data":"fa828728ac5e7f290af98bd9da0cc47d35b7c08ac5bae2667dfd3a292ee69c63"}
Oct 30 22:00:04.323572 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.323555    5575 scope.go:122] "RemoveContainer" containerID="fa828728ac5e7f290af98bd9da0cc47d35b7c08ac5bae2667dfd3a292ee69c63"
Oct 30 22:00:04.323996 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:04.323901    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn_odh-ai-gateway-infra(41181fce-e504-46b5-98bf-e04e89946a69)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" podUID="41181fce-e504-46b5-98bf-e04e89946a69"
Oct 30 22:00:04.344132 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.344108    5575 scope.go:122] "RemoveContainer" containerID="b9ed488b3ad588e35bcbde4fb43c6d488668cdfbffde3ac33010a963a4f362c3"
Oct 30 22:00:04.358761 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.358719    5575 scope.go:122] "RemoveContainer" containerID="a7c7e717f75d497406b0ecef96e9aad501745824412aa723e85b7333d4816f8e"
Oct 30 22:00:04.365794 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.365768    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8mvt\" (UniqueName: \"kubernetes.io/projected/4a31690a-328d-4349-8387-26e9dced072c-kube-api-access-b8mvt\") pod \"maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.386002 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.385947    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:04.552186 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.552154    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:04.638086 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.638061    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:04.992538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:04.992457    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:05.030350 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:05.030319    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"]
Oct 30 22:00:05.032276 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:00:05.032250    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a31690a_328d_4349_8387_26e9dced072c.slice/crio-4b2d111a0f4720b5f0d496b6a31bb9a8e8a0ce68d5690dbd2434f2e6afc0ad4c WatchSource:0}: Error finding container 4b2d111a0f4720b5f0d496b6a31bb9a8e8a0ce68d5690dbd2434f2e6afc0ad4c: Status 404 returned error can't find the container with id 4b2d111a0f4720b5f0d496b6a31bb9a8e8a0ce68d5690dbd2434f2e6afc0ad4c
Oct 30 22:00:05.033996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:05.033959    5575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:00:05.337469 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:05.337279    5575 scope.go:122] "RemoveContainer" containerID="fa828728ac5e7f290af98bd9da0cc47d35b7c08ac5bae2667dfd3a292ee69c63"
Oct 30 22:00:05.337924 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:05.337647    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn_odh-ai-gateway-infra(41181fce-e504-46b5-98bf-e04e89946a69)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" podUID="41181fce-e504-46b5-98bf-e04e89946a69"
Oct 30 22:00:05.338832 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:05.338800    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x" event={"ID":"4a31690a-328d-4349-8387-26e9dced072c","Type":"ContainerStarted","Data":"4b2d111a0f4720b5f0d496b6a31bb9a8e8a0ce68d5690dbd2434f2e6afc0ad4c"}
Oct 30 22:00:05.341200 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:05.341177    5575 scope.go:122] "RemoveContainer" containerID="9739da7e147ece5c228eb7f620c093fb137db9d9cc115fb6d774fc4ad641653f"
Oct 30 22:00:05.341464 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:05.341437    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h_odh-ai-gateway-infra(b1db47cf-056c-43e2-a165-2f758c98f32a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a"
Oct 30 22:00:05.343846 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:05.343825    5575 scope.go:122] "RemoveContainer" containerID="8cbbef9e459068c9f2f21ecc0a68bd00287af3de927f2e7b47dfe1f2ed3a058f"
Oct 30 22:00:05.344184 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:05.344149    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889960-p9cpc_odh-ai-gateway-infra(085a757a-a7ac-40c3-ae9d-79022c4ec250)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250"
Oct 30 22:00:06.182302 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:06.182266    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:06.347556 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:06.347511    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:06.355171 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:06.355139    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x" event={"ID":"4a31690a-328d-4349-8387-26e9dced072c","Type":"ContainerStarted","Data":"1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13"}
Oct 30 22:00:06.355385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:06.355197    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:06.487874 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:06.487763    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x" podStartSLOduration=2.698139451 podStartE2EDuration="3.487747096s" totalImagesPullingTime="789.607645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:06.486112805 +0000 UTC m=+2207.517961340" watchObservedRunningTime="2026-10-30 22:00:06.487747096 +0000 UTC m=+2207.519595633"
Oct 30 22:00:06.645434 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:06.645398    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"]
Oct 30 22:00:06.645679 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:06.645653    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy" containerID="cri-o://216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e" gracePeriod=30
Oct 30 22:00:06.654052 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:06.653999    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:07.478223 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:07.478193    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:08.171185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:08.170937    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:08.371572 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:08.371520    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:09.818396 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:09.818355    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:10.795132 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:10.795100    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:11.771853 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:11.771814    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:11.961735 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:11.961644    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:11.997833 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:11.997804    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 22:00:12.059250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059209    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-credential-socket\") pod \"c7a176d0-0829-498e-9570-ad1624881eec\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") "
Oct 30 22:00:12.059435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059262    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-certs\") pod \"c7a176d0-0829-498e-9570-ad1624881eec\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") "
Oct 30 22:00:12.059435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059291    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-data\") pod \"c7a176d0-0829-498e-9570-ad1624881eec\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") "
Oct 30 22:00:12.059435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059363    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7a176d0-0829-498e-9570-ad1624881eec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a176d0-0829-498e-9570-ad1624881eec-istiod-ca-cert\") pod \"c7a176d0-0829-498e-9570-ad1624881eec\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") "
Oct 30 22:00:12.059610 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059536    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-socket\") pod \"c7a176d0-0829-498e-9570-ad1624881eec\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") "
Oct 30 22:00:12.059610 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059547    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-credential-socket" pod "c7a176d0-0829-498e-9570-ad1624881eec" (UID: "c7a176d0-0829-498e-9570-ad1624881eec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:12.059610 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059587    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-envoy\") pod \"c7a176d0-0829-498e-9570-ad1624881eec\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") "
Oct 30 22:00:12.059826 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059640    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-kube-api-access-zm5wk\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-kube-api-access-zm5wk\") pod \"c7a176d0-0829-498e-9570-ad1624881eec\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") "
Oct 30 22:00:12.059826 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059699    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-certs" pod "c7a176d0-0829-498e-9570-ad1624881eec" (UID: "c7a176d0-0829-498e-9570-ad1624881eec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:12.059826 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059732    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-istio-token\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-istio-token\") pod \"c7a176d0-0829-498e-9570-ad1624881eec\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") "
Oct 30 22:00:12.059826 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059778    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c7a176d0-0829-498e-9570-ad1624881eec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a176d0-0829-498e-9570-ad1624881eec-istio-podinfo\") pod \"c7a176d0-0829-498e-9570-ad1624881eec\" (UID: \"c7a176d0-0829-498e-9570-ad1624881eec\") "
Oct 30 22:00:12.059826 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059785    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-socket" pod "c7a176d0-0829-498e-9570-ad1624881eec" (UID: "c7a176d0-0829-498e-9570-ad1624881eec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:12.060122 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059900    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a176d0-0829-498e-9570-ad1624881eec-istiod-ca-cert" pod "c7a176d0-0829-498e-9570-ad1624881eec" (UID: "c7a176d0-0829-498e-9570-ad1624881eec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:12.060122 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.059959    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-data" pod "c7a176d0-0829-498e-9570-ad1624881eec" (UID: "c7a176d0-0829-498e-9570-ad1624881eec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:12.060435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.060411    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:12.060435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.060436    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:12.060435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.060445    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:12.060691 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.060453    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:12.060691 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.060463    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a176d0-0829-498e-9570-ad1624881eec-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:12.062718 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.062675    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-kube-api-access-zm5wk" pod "c7a176d0-0829-498e-9570-ad1624881eec" (UID: "c7a176d0-0829-498e-9570-ad1624881eec"). InnerVolumeSpecName "kube-api-access-zm5wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:12.065201 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.065181    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7a176d0-0829-498e-9570-ad1624881eec-istio-podinfo" pod "c7a176d0-0829-498e-9570-ad1624881eec" (UID: "c7a176d0-0829-498e-9570-ad1624881eec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:00:12.065395 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.065375    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-envoy" pod "c7a176d0-0829-498e-9570-ad1624881eec" (UID: "c7a176d0-0829-498e-9570-ad1624881eec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:12.065490 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.065411    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-istio-token" pod "c7a176d0-0829-498e-9570-ad1624881eec" (UID: "c7a176d0-0829-498e-9570-ad1624881eec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:12.161775 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.161706    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:12.161775 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.161739    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a176d0-0829-498e-9570-ad1624881eec-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:12.161775 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.161754    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a176d0-0829-498e-9570-ad1624881eec-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:12.161775 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.161768    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm5wk\" (UniqueName: \"kubernetes.io/projected/c7a176d0-0829-498e-9570-ad1624881eec-kube-api-access-zm5wk\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:12.403136 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.403105    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:00:12.445991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.445937    5575 generic.go:356] "Generic (PLEG): container finished" podID="c7a176d0-0829-498e-9570-ad1624881eec" containerID="216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e" exitCode=0
Oct 30 22:00:12.446209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.446028    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" event={"ID":"c7a176d0-0829-498e-9570-ad1624881eec","Type":"ContainerDied","Data":"216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e"}
Oct 30 22:00:12.446209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.446080    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj" event={"ID":"c7a176d0-0829-498e-9570-ad1624881eec","Type":"ContainerDied","Data":"b2fb672f87791afbc48b86b7109c09f741192e47ec96ce982e8240c3b71ba37d"}
Oct 30 22:00:12.446209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.446109    5575 scope.go:122] "RemoveContainer" containerID="216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e"
Oct 30 22:00:12.446476 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.446277    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"
Oct 30 22:00:12.461636 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.461613    5575 scope.go:122] "RemoveContainer" containerID="5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c"
Oct 30 22:00:12.472493 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.472470    5575 scope.go:122] "RemoveContainer" containerID="216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e"
Oct 30 22:00:12.472787 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:12.472766    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e\": container with ID starting with 216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e not found: ID does not exist" containerID="216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e"
Oct 30 22:00:12.472854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.472794    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e"} err="failed to get container status \"216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e\": rpc error: code = NotFound desc = could not find container \"216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e\": container with ID starting with 216d9438955c86e764ee93f96bea5d203b7230d77e20d0aba71dcd7c933deb1e not found: ID does not exist"
Oct 30 22:00:12.472854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.472812    5575 scope.go:122] "RemoveContainer" containerID="5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c"
Oct 30 22:00:12.473039 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:12.473023    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c\": container with ID starting with 5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c not found: ID does not exist" containerID="5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c"
Oct 30 22:00:12.473091 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.473045    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c"} err="failed to get container status \"5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c\": rpc error: code = NotFound desc = could not find container \"5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c\": container with ID starting with 5fd94839fdcaca7e996edfcf860df8f6a1f191627ff8676d1965293655a4e48c not found: ID does not exist"
Oct 30 22:00:12.641639 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.641604    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"]
Oct 30 22:00:12.651607 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.651580    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-5bfa09-openshift-default-5d9f9b794f-cdbnj"]
Oct 30 22:00:12.666196 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:12.666117    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:13.022383 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:13.022288    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:13.128471 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:13.128441    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7a176d0-0829-498e-9570-ad1624881eec" path="/var/lib/kubelet/pods/c7a176d0-0829-498e-9570-ad1624881eec/volumes"
Oct 30 22:00:13.228026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:13.224702    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:13.978181 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:13.978145    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:14.119896 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.119868    5575 scope.go:122] "RemoveContainer" containerID="fa828728ac5e7f290af98bd9da0cc47d35b7c08ac5bae2667dfd3a292ee69c63"
Oct 30 22:00:14.475525 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.475495    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" event={"ID":"41181fce-e504-46b5-98bf-e04e89946a69","Type":"ContainerStarted","Data":"bd607eac6ad61324f23cffbb7f2229c8b5bcb3f9b1abab870b4020e747151287"}
Oct 30 22:00:14.665164 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.665131    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"]
Oct 30 22:00:14.665821 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.665801    5575 cpu_manager.go:414] "containerMap: removing container" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy"
Oct 30 22:00:14.665821 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.665817    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy"
Oct 30 22:00:14.666034 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.665961    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy"
Oct 30 22:00:14.666034 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.665990    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy"
Oct 30 22:00:14.669690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.669671    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.725020 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.722167    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-98d38f-openshift-default-dockercfg-z2g6b\""
Oct 30 22:00:14.732661 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.732620    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"]
Oct 30 22:00:14.794060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.794028    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:14.804493 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.804466    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-socket\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.804694 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.804673    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bncmh\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-kube-api-access-bncmh\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.804769 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.804728    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istiod-ca-cert\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.804834 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.804815    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-credential-socket\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.804909 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.804896    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-envoy\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.804979 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.804952    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-podinfo\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.805046 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.805029    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-certs\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.805079 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.805058    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-token\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.805121 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.805092    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-data\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906193 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906066    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-data\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906193 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906128    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-socket\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906270    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bncmh\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-kube-api-access-bncmh\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906312    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istiod-ca-cert\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906472    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-credential-socket\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906501    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-data\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906521    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-socket\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906814 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906603    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-envoy\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906814 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906653    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-podinfo\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906814 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906681    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-certs\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906814 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906696    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-credential-socket\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.906814 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.906698    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-token\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.907148 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.907118    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istiod-ca-cert\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.907202 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.907122    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-certs\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.909251 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.909226    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-envoy\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.909438 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.909421    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-podinfo\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.967686 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.967622    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-token\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.967844 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.967715    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bncmh\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-kube-api-access-bncmh\") pod \"e2e-api-a-98d38f-openshift-default-849d69489c-86r2d\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") " pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:14.983663 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:14.983637    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:15.325008 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.324847    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:15.428624 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.428595    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"]
Oct 30 22:00:15.429341 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:00:15.429301    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1f948f_33f3_4da6_895d_0f2e0ef2b7fc.slice/crio-f7831a5b423985e9f984d53c4b0b36f0a3493778ee75ab94504b108354a41dad WatchSource:0}: Error finding container f7831a5b423985e9f984d53c4b0b36f0a3493778ee75ab94504b108354a41dad: Status 404 returned error can't find the container with id f7831a5b423985e9f984d53c4b0b36f0a3493778ee75ab94504b108354a41dad
Oct 30 22:00:15.432553 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.432512    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:15.432662 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.432598    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:15.432662 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.432644    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:15.488713 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.488661    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" event={"ID":"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc","Type":"ContainerStarted","Data":"f7831a5b423985e9f984d53c4b0b36f0a3493778ee75ab94504b108354a41dad"}
Oct 30 22:00:15.491079 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.491054    5575 generic.go:356] "Generic (PLEG): container finished" podID="41181fce-e504-46b5-98bf-e04e89946a69" containerID="bd607eac6ad61324f23cffbb7f2229c8b5bcb3f9b1abab870b4020e747151287" exitCode=60
Oct 30 22:00:15.491169 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.491130    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" event={"ID":"41181fce-e504-46b5-98bf-e04e89946a69","Type":"ContainerDied","Data":"bd607eac6ad61324f23cffbb7f2229c8b5bcb3f9b1abab870b4020e747151287"}
Oct 30 22:00:15.491227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.491193    5575 scope.go:122] "RemoveContainer" containerID="fa828728ac5e7f290af98bd9da0cc47d35b7c08ac5bae2667dfd3a292ee69c63"
Oct 30 22:00:15.491614 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.491596    5575 scope.go:122] "RemoveContainer" containerID="bd607eac6ad61324f23cffbb7f2229c8b5bcb3f9b1abab870b4020e747151287"
Oct 30 22:00:15.491986 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:15.491947    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn_odh-ai-gateway-infra(41181fce-e504-46b5-98bf-e04e89946a69)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" podUID="41181fce-e504-46b5-98bf-e04e89946a69"
Oct 30 22:00:15.646476 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.646447    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"]
Oct 30 22:00:15.700880 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:15.700217    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:16.119719 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.119635    5575 scope.go:122] "RemoveContainer" containerID="9739da7e147ece5c228eb7f620c093fb137db9d9cc115fb6d774fc4ad641653f"
Oct 30 22:00:16.119881 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.119727    5575 scope.go:122] "RemoveContainer" containerID="8cbbef9e459068c9f2f21ecc0a68bd00287af3de927f2e7b47dfe1f2ed3a058f"
Oct 30 22:00:16.394839 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.394787    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:16.505112 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.505081    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" event={"ID":"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc","Type":"ContainerStarted","Data":"8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a"}
Oct 30 22:00:16.575339 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.575308    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:16.629795 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.629738    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" podStartSLOduration=2.629725218 podStartE2EDuration="2.629725218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:16.626369378 +0000 UTC m=+2217.658217914" watchObservedRunningTime="2026-10-30 22:00:16.629725218 +0000 UTC m=+2217.661573752"
Oct 30 22:00:16.671940 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.671915    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:16.767418 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.760316    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:16.778132 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.776627    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/41181fce-e504-46b5-98bf-e04e89946a69-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41181fce-e504-46b5-98bf-e04e89946a69-maas-api-service-ca\") pod \"41181fce-e504-46b5-98bf-e04e89946a69\" (UID: \"41181fce-e504-46b5-98bf-e04e89946a69\") "
Oct 30 22:00:16.778319 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.778236    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41181fce-e504-46b5-98bf-e04e89946a69-kube-api-access-wjbzb\" (UniqueName: \"kubernetes.io/projected/41181fce-e504-46b5-98bf-e04e89946a69-kube-api-access-wjbzb\") pod \"41181fce-e504-46b5-98bf-e04e89946a69\" (UID: \"41181fce-e504-46b5-98bf-e04e89946a69\") "
Oct 30 22:00:16.798989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.777008    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41181fce-e504-46b5-98bf-e04e89946a69-maas-api-service-ca" pod "41181fce-e504-46b5-98bf-e04e89946a69" (UID: "41181fce-e504-46b5-98bf-e04e89946a69"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:16.835992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.832924    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41181fce-e504-46b5-98bf-e04e89946a69-kube-api-access-wjbzb" pod "41181fce-e504-46b5-98bf-e04e89946a69" (UID: "41181fce-e504-46b5-98bf-e04e89946a69"). InnerVolumeSpecName "kube-api-access-wjbzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:16.889161 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.889126    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41181fce-e504-46b5-98bf-e04e89946a69-maas-api-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:16.894275 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.894245    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjbzb\" (UniqueName: \"kubernetes.io/projected/41181fce-e504-46b5-98bf-e04e89946a69-kube-api-access-wjbzb\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:16.958172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.958086    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:16.984099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.984074    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:16.989347 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:16.989327    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:17.205103 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.205059    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:17.518381 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.518305    5575 generic.go:356] "Generic (PLEG): container finished" podID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerID="9dfd1352097ea3e79794678845618636138cb9496dbc0598adab0198136b8448" exitCode=60
Oct 30 22:00:17.518381 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.518360    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" event={"ID":"b1db47cf-056c-43e2-a165-2f758c98f32a","Type":"ContainerDied","Data":"9dfd1352097ea3e79794678845618636138cb9496dbc0598adab0198136b8448"}
Oct 30 22:00:17.518861 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.518418    5575 scope.go:122] "RemoveContainer" containerID="9739da7e147ece5c228eb7f620c093fb137db9d9cc115fb6d774fc4ad641653f"
Oct 30 22:00:17.518861 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.518765    5575 scope.go:122] "RemoveContainer" containerID="9dfd1352097ea3e79794678845618636138cb9496dbc0598adab0198136b8448"
Oct 30 22:00:17.519176 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:17.519116    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h_odh-ai-gateway-infra(b1db47cf-056c-43e2-a165-2f758c98f32a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a"
Oct 30 22:00:17.521812 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.521784    5575 generic.go:356] "Generic (PLEG): container finished" podID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerID="0083f16436a2ba4ce8f407bded56ba393ceb07a8a9e0ad26900b32583749fc9a" exitCode=60
Oct 30 22:00:17.521921 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.521854    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" event={"ID":"085a757a-a7ac-40c3-ae9d-79022c4ec250","Type":"ContainerDied","Data":"0083f16436a2ba4ce8f407bded56ba393ceb07a8a9e0ad26900b32583749fc9a"}
Oct 30 22:00:17.522232 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.522213    5575 scope.go:122] "RemoveContainer" containerID="0083f16436a2ba4ce8f407bded56ba393ceb07a8a9e0ad26900b32583749fc9a"
Oct 30 22:00:17.522629 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:17.522593    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29889960-p9cpc_odh-ai-gateway-infra(085a757a-a7ac-40c3-ae9d-79022c4ec250)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250"
Oct 30 22:00:17.523956 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.523928    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn" event={"ID":"41181fce-e504-46b5-98bf-e04e89946a69","Type":"ContainerDied","Data":"52a7ecdbb8437dedcc3f800d4f0466c1b8451fb5aadb341c2331a10c0c8b9bbc"}
Oct 30 22:00:17.524400 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.524376    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:17.524518 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.524504    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"
Oct 30 22:00:17.525536 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.525516    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:00:17.535138 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.535122    5575 scope.go:122] "RemoveContainer" containerID="8cbbef9e459068c9f2f21ecc0a68bd00287af3de927f2e7b47dfe1f2ed3a058f"
Oct 30 22:00:17.548532 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.548501    5575 scope.go:122] "RemoveContainer" containerID="bd607eac6ad61324f23cffbb7f2229c8b5bcb3f9b1abab870b4020e747151287"
Oct 30 22:00:17.877482 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.877402    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"]
Oct 30 22:00:17.883118 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:17.883090    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-fd2a94-29889960-fvkkn"]
Oct 30 22:00:18.667932 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:18.667903    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"]
Oct 30 22:00:18.778052 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:18.778020    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"]
Oct 30 22:00:18.874749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:18.874723    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:18.951271 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:18.951241    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1db47cf-056c-43e2-a165-2f758c98f32a-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1db47cf-056c-43e2-a165-2f758c98f32a-maas-api-service-ca\") pod \"b1db47cf-056c-43e2-a165-2f758c98f32a\" (UID: \"b1db47cf-056c-43e2-a165-2f758c98f32a\") "
Oct 30 22:00:18.951426 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:18.951296    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1db47cf-056c-43e2-a165-2f758c98f32a-kube-api-access-kq2xp\" (UniqueName: \"kubernetes.io/projected/b1db47cf-056c-43e2-a165-2f758c98f32a-kube-api-access-kq2xp\") pod \"b1db47cf-056c-43e2-a165-2f758c98f32a\" (UID: \"b1db47cf-056c-43e2-a165-2f758c98f32a\") "
Oct 30 22:00:18.951573 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:18.951553    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1db47cf-056c-43e2-a165-2f758c98f32a-maas-api-service-ca" pod "b1db47cf-056c-43e2-a165-2f758c98f32a" (UID: "b1db47cf-056c-43e2-a165-2f758c98f32a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:18.951868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:18.951853    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1db47cf-056c-43e2-a165-2f758c98f32a-maas-api-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:18.953551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:18.953527    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1db47cf-056c-43e2-a165-2f758c98f32a-kube-api-access-kq2xp" pod "b1db47cf-056c-43e2-a165-2f758c98f32a" (UID: "b1db47cf-056c-43e2-a165-2f758c98f32a"). InnerVolumeSpecName "kube-api-access-kq2xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:18.980550 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:18.980527    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:19.052855 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.052822    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/085a757a-a7ac-40c3-ae9d-79022c4ec250-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/085a757a-a7ac-40c3-ae9d-79022c4ec250-maas-api-service-ca\") pod \"085a757a-a7ac-40c3-ae9d-79022c4ec250\" (UID: \"085a757a-a7ac-40c3-ae9d-79022c4ec250\") "
Oct 30 22:00:19.053097 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.053076    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/085a757a-a7ac-40c3-ae9d-79022c4ec250-kube-api-access-g2trh\" (UniqueName: \"kubernetes.io/projected/085a757a-a7ac-40c3-ae9d-79022c4ec250-kube-api-access-g2trh\") pod \"085a757a-a7ac-40c3-ae9d-79022c4ec250\" (UID: \"085a757a-a7ac-40c3-ae9d-79022c4ec250\") "
Oct 30 22:00:19.053293 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.053266    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/085a757a-a7ac-40c3-ae9d-79022c4ec250-maas-api-service-ca" pod "085a757a-a7ac-40c3-ae9d-79022c4ec250" (UID: "085a757a-a7ac-40c3-ae9d-79022c4ec250"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:19.053725 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.053698    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq2xp\" (UniqueName: \"kubernetes.io/projected/b1db47cf-056c-43e2-a165-2f758c98f32a-kube-api-access-kq2xp\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:19.053840 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.053730    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/085a757a-a7ac-40c3-ae9d-79022c4ec250-maas-api-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:19.055857 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.055828    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085a757a-a7ac-40c3-ae9d-79022c4ec250-kube-api-access-g2trh" pod "085a757a-a7ac-40c3-ae9d-79022c4ec250" (UID: "085a757a-a7ac-40c3-ae9d-79022c4ec250"). InnerVolumeSpecName "kube-api-access-g2trh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:19.130147 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.130101    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="41181fce-e504-46b5-98bf-e04e89946a69" path="/var/lib/kubelet/pods/41181fce-e504-46b5-98bf-e04e89946a69/volumes"
Oct 30 22:00:19.154775 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.154752    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2trh\" (UniqueName: \"kubernetes.io/projected/085a757a-a7ac-40c3-ae9d-79022c4ec250-kube-api-access-g2trh\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:19.553995 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.553657    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"
Oct 30 22:00:19.553995 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.553921    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h" event={"ID":"b1db47cf-056c-43e2-a165-2f758c98f32a","Type":"ContainerDied","Data":"d7cf1788b21e6c2e0846d76cf62c8d828da59690729f6be1e37dc5f0166268b7"}
Oct 30 22:00:19.554273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.554082    5575 scope.go:122] "RemoveContainer" containerID="9dfd1352097ea3e79794678845618636138cb9496dbc0598adab0198136b8448"
Oct 30 22:00:19.557154 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.557130    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"
Oct 30 22:00:19.557366 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.557261    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc" event={"ID":"085a757a-a7ac-40c3-ae9d-79022c4ec250","Type":"ContainerDied","Data":"907144ea9c4f470873a4745a9767b82f758ebd01ad1de4245733361006ce34b4"}
Oct 30 22:00:19.568226 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.568209    5575 scope.go:122] "RemoveContainer" containerID="0083f16436a2ba4ce8f407bded56ba393ceb07a8a9e0ad26900b32583749fc9a"
Oct 30 22:00:19.731153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.731119    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"]
Oct 30 22:00:19.747801 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.747771    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-p9cpc"]
Oct 30 22:00:19.782766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.782741    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:19.948979 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.947387    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"]
Oct 30 22:00:19.953784 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.953755    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-691598-29889960-ct95h"]
Oct 30 22:00:19.974152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:19.974120    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:20.437990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:20.436935    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:20.667544 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:20.667510    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:20.845586 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:20.845502    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:21.131954 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:21.131924    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" path="/var/lib/kubelet/pods/085a757a-a7ac-40c3-ae9d-79022c4ec250/volumes"
Oct 30 22:00:21.132567 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:21.132547    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" path="/var/lib/kubelet/pods/b1db47cf-056c-43e2-a165-2f758c98f32a/volumes"
Oct 30 22:00:21.457036 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:21.456625    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:23.489443 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:23.489399    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:00:23.545401 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.545364    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"]
Oct 30 22:00:23.546041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546026    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerName="cleanup"
Oct 30 22:00:23.546041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546040    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546059    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546064    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546073    5575 cpu_manager.go:414] "containerMap: removing container" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546077    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546083    5575 cpu_manager.go:414] "containerMap: removing container" podUID="41181fce-e504-46b5-98bf-e04e89946a69" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546087    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41181fce-e504-46b5-98bf-e04e89946a69" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546093    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546097    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546105    5575 cpu_manager.go:414] "containerMap: removing container" podUID="41181fce-e504-46b5-98bf-e04e89946a69" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546109    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41181fce-e504-46b5-98bf-e04e89946a69" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546114    5575 cpu_manager.go:414] "containerMap: removing container" podUID="41181fce-e504-46b5-98bf-e04e89946a69" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546118    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41181fce-e504-46b5-98bf-e04e89946a69" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546145    5575 cpu_manager.go:414] "containerMap: removing container" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546149    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7a176d0-0829-498e-9570-ad1624881eec" containerName="istio-proxy"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546156    5575 cpu_manager.go:414] "containerMap: removing container" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerName="cleanup"
Oct 30 22:00:23.546210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546162    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerName="cleanup"
Oct 30 22:00:23.547015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546251    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerName="cleanup"
Oct 30 22:00:23.547015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546260    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerName="cleanup"
Oct 30 22:00:23.547015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546269    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerName="cleanup"
Oct 30 22:00:23.547015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546276    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerName="cleanup"
Oct 30 22:00:23.547015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546291    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerName="cleanup"
Oct 30 22:00:23.547015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546298    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="41181fce-e504-46b5-98bf-e04e89946a69" containerName="cleanup"
Oct 30 22:00:23.547015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546303    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1db47cf-056c-43e2-a165-2f758c98f32a" containerName="cleanup"
Oct 30 22:00:23.547015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546309    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="41181fce-e504-46b5-98bf-e04e89946a69" containerName="cleanup"
Oct 30 22:00:23.547015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.546315    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="41181fce-e504-46b5-98bf-e04e89946a69" containerName="cleanup"
Oct 30 22:00:23.551917 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.551895    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.582716 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.582691    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:23.607073 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.607052    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-71a3d788-openshift-default-dockercfg-6mkwc\""
Oct 30 22:00:23.657716 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.657685    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c46f9c7-cf68-4884-9094-f2232d131174-istiod-ca-cert\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.658558 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.658338    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-envoy\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.658827 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.658797    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-certs\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.659460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.658857    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-data\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.659460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.658943    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrzcx\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-kube-api-access-hrzcx\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.659460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.659022    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.659460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.659071    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-credential-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.659460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.659138    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c46f9c7-cf68-4884-9094-f2232d131174-istio-podinfo\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.659460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.659211    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-istio-token\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.663195 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.663166    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"]
Oct 30 22:00:23.760957 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.760868    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-certs\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.760957 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.760914    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-data\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.760957 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.760988    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrzcx\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-kube-api-access-hrzcx\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761289 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761024    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761289 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761050    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-credential-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761289 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761087    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c46f9c7-cf68-4884-9094-f2232d131174-istio-podinfo\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761289 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761136    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-istio-token\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761289 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761216    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c46f9c7-cf68-4884-9094-f2232d131174-istiod-ca-cert\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761289 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761252    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-envoy\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761289 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761271    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-certs\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761671 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761370    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761671 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761476    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-credential-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761671 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761529    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-data\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.761893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.761874    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c46f9c7-cf68-4884-9094-f2232d131174-istiod-ca-cert\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.763547 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.763531    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-envoy\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.763850 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.763832    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c46f9c7-cf68-4884-9094-f2232d131174-istio-podinfo\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.823348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.823318    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-istio-token\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.837484 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.837460    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrzcx\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-kube-api-access-hrzcx\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-ztdbm\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:23.866067 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:23.866042    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:24.087892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.087791    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:24.312320 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.312290    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"]
Oct 30 22:00:24.313163 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:00:24.313134    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c46f9c7_cf68_4884_9094_f2232d131174.slice/crio-3334a756f5728a4b84f2a885ea10dd5a411ba4a6422abfddcbdfad442bb39fbb WatchSource:0}: Error finding container 3334a756f5728a4b84f2a885ea10dd5a411ba4a6422abfddcbdfad442bb39fbb: Status 404 returned error can't find the container with id 3334a756f5728a4b84f2a885ea10dd5a411ba4a6422abfddcbdfad442bb39fbb
Oct 30 22:00:24.313163 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.313138    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:24.316156 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.316123    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:24.316292 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.316186    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:24.316292 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.316214    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:24.472250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.472218    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:24.599386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.599354    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" event={"ID":"6c46f9c7-cf68-4884-9094-f2232d131174","Type":"ContainerStarted","Data":"25cda5cfa928bb20c581f269a21677e1233a24b2fcf02ae4f8cc334652328158"}
Oct 30 22:00:24.599795 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.599405    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" event={"ID":"6c46f9c7-cf68-4884-9094-f2232d131174","Type":"ContainerStarted","Data":"3334a756f5728a4b84f2a885ea10dd5a411ba4a6422abfddcbdfad442bb39fbb"}
Oct 30 22:00:24.803429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.803394    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:24.866183 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.866148    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:24.999158 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:24.999125    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:25.868804 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:25.868769    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:00:25.869215 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:25.868830    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:00:26.872408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:26.872370    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:00:26.873125 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:26.873091    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:00:26.947373 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:26.944547    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:27.868818 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:27.868063    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:00:27.868818 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:27.868166    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:00:28.866728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:28.866694    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:00:28.867158 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:28.866757    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:00:29.866931 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:29.866889    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:00:29.867431 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:29.866959    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:00:30.866435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:30.866391    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:00:30.866693 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:30.866444    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:00:31.871476 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:31.871443    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:31.871988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:31.871907    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:31.872720 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:31.872694    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:00:32.045922 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:32.045865    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" podStartSLOduration=9.045851303 podStartE2EDuration="9.045851303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:24.731939363 +0000 UTC m=+2225.763787899" watchObservedRunningTime="2026-10-30 22:00:32.045851303 +0000 UTC m=+2233.077699839"
Oct 30 22:00:32.368236 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:32.368208    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:34.701947 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:34.701906    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:34.868896 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:34.868863    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:35.353207 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.353170    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"]
Oct 30 22:00:35.358015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.354369    5575 cpu_manager.go:414] "containerMap: removing container" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerName="cleanup"
Oct 30 22:00:35.358015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.354392    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="085a757a-a7ac-40c3-ae9d-79022c4ec250" containerName="cleanup"
Oct 30 22:00:35.361081 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.361055    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:35.385783 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.384925    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"]
Oct 30 22:00:35.415254 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.415194    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-ae1bd5\""
Oct 30 22:00:35.464178 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.464143    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-ae1bd5-dockercfg-rvbll\""
Oct 30 22:00:35.545728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.545693    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5\" (UID: \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\") " pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:35.545728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.545733    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grnf5\" (UniqueName: \"kubernetes.io/projected/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-kube-api-access-grnf5\") pod \"payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5\" (UID: \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\") " pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:35.647068 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.647032    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5\" (UID: \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\") " pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:35.647393 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.647075    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grnf5\" (UniqueName: \"kubernetes.io/projected/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-kube-api-access-grnf5\") pod \"payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5\" (UID: \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\") " pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:35.647829 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.647804    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5\" (UID: \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\") " pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:35.709435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.709394    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grnf5\" (UniqueName: \"kubernetes.io/projected/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-kube-api-access-grnf5\") pod \"payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5\" (UID: \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\") " pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:35.991215 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:35.991181    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:36.378098 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.378068    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"]
Oct 30 22:00:36.379297 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:00:36.379267    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b836e9_6dee_44b6_a6c9_3beffd1ac3d9.slice/crio-ea4f4c43fba19e4318a6fba4416d50e4ba4ff54946f7d4267dffa3413a2b1222 WatchSource:0}: Error finding container ea4f4c43fba19e4318a6fba4416d50e4ba4ff54946f7d4267dffa3413a2b1222: Status 404 returned error can't find the container with id ea4f4c43fba19e4318a6fba4416d50e4ba4ff54946f7d4267dffa3413a2b1222
Oct 30 22:00:36.768031 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.767998    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5" event={"ID":"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9","Type":"ContainerStarted","Data":"8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6"}
Oct 30 22:00:36.768443 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.768087    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5" event={"ID":"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9","Type":"ContainerStarted","Data":"ea4f4c43fba19e4318a6fba4416d50e4ba4ff54946f7d4267dffa3413a2b1222"}
Oct 30 22:00:36.768443 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.768233    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:36.769852 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.769827    5575 generic.go:356] "Generic (PLEG): container finished" podID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerID="ab67a402c473308a79f5e91689250b03fd28b13d2fd45c9a21e9a0148ac888de" exitCode=0
Oct 30 22:00:36.769996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.769893    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" event={"ID":"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef","Type":"ContainerDied","Data":"ab67a402c473308a79f5e91689250b03fd28b13d2fd45c9a21e9a0148ac888de"}
Oct 30 22:00:36.770283 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.770266    5575 scope.go:122] "RemoveContainer" containerID="ab67a402c473308a79f5e91689250b03fd28b13d2fd45c9a21e9a0148ac888de"
Oct 30 22:00:36.771859 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.771832    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:36.771914 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.771900    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:36.771949 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.771933    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:36.890752 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:36.890691    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5" podStartSLOduration=1.890673346 podStartE2EDuration="1.890673346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:36.885769982 +0000 UTC m=+2237.917618522" watchObservedRunningTime="2026-10-30 22:00:36.890673346 +0000 UTC m=+2237.922521882"
Oct 30 22:00:37.267250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:37.267215    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:37.779854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:37.779821    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" event={"ID":"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef","Type":"ContainerStarted","Data":"f871fd651ec050c38fb5d03755cb0540004f156a8e6a2f01a2bc9108f406e17a"}
Oct 30 22:00:38.459410 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.459374    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 22:00:38.459609 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.459560    5575 patch_prober.go:29] interesting pod/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 22:00:38.459609 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.459598    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 22:00:38.592787 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.592744    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:38.677104 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.677071    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"]
Oct 30 22:00:38.681084 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.681064    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.696533 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.696505    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-envoy\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.696635 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.696563    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istiod-ca-cert\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.696747 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.696724    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-podinfo\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.696802 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.696787    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.696904 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.696885    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-token\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.697002 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.696981    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-data\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.697065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.697020    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-credential-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.697110 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.697095    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmhv4\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-kube-api-access-kmhv4\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.697191 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.697176    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-certs\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.743122 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.743029    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"]
Oct 30 22:00:38.747572 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.747546    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"]
Oct 30 22:00:38.747712 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.747665    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.798952 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.798922    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-token\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.799440 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.798989    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-podinfo\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.799440 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.799069    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgnr9\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-kube-api-access-sgnr9\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.799440 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.799138    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-certs\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.799440 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.799232    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-envoy\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.799440 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.799280    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-certs\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.799440 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.799314    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istiod-ca-cert\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.799949 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.799919    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc604a8-e33e-4237-b434-95a33c21b8aa-istiod-ca-cert\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.800073 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.800032    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-envoy\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.800134 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.800105    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-data\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.800190 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.800138    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-podinfo\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.800190 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.800164    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.800299 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.800219    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-credential-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.800299 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.800247    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.800819 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.800795    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istiod-ca-cert\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.800819 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.800805    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.801006 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.800855    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-token\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.801123 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.801099    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-certs\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.801369 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.801351    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-data\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.801459 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.801394    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-credential-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.801459 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.801435    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmhv4\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-kube-api-access-kmhv4\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.802501 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.802477    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-data\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.802903 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.802856    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-credential-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.803243 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.803224    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-envoy\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.804036 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.804015    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-podinfo\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.865935 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.865907    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmhv4\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-kube-api-access-kmhv4\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.868327 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.868300    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"]
Oct 30 22:00:38.888508 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.888476    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-token\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-r7gcc\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:38.902303 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.902273    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-certs\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.902465 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.902453    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc604a8-e33e-4237-b434-95a33c21b8aa-istiod-ca-cert\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.902551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.902543    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-envoy\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903174    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-certs\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903351 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903220    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-data\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903466 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903450    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903586 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903570    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-credential-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903773 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903497    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-data\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903836 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903764    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903836 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903757    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-token\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903901 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903831    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-podinfo\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903939 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903900    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgnr9\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-kube-api-access-sgnr9\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.903939 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.903602    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc604a8-e33e-4237-b434-95a33c21b8aa-istiod-ca-cert\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.904231 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.904103    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-credential-socket\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.905766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.905741    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-envoy\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.946659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.946624    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-podinfo\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.966579 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.966549    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-token\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.966714 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.966647    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgnr9\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-kube-api-access-sgnr9\") pod \"e2e-mt-71a3d788-openshift-default-778558588f-vmdx7\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") " pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:38.994529 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:38.994453    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:39.060397 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.060359    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:39.459374 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.459334    5575 patch_prober.go:29] interesting pod/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 22:00:39.459542 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.459399    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 22:00:39.483903 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:00:39.483867    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4d11d5_e205_43e7_bd12_0c2323cb2b1c.slice/crio-7d04c6ca7240fcdf2204db6154316acaf2e03b3b872f2f515c8e4531512bbb32 WatchSource:0}: Error finding container 7d04c6ca7240fcdf2204db6154316acaf2e03b3b872f2f515c8e4531512bbb32: Status 404 returned error can't find the container with id 7d04c6ca7240fcdf2204db6154316acaf2e03b3b872f2f515c8e4531512bbb32
Oct 30 22:00:39.485242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.485219    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"]
Oct 30 22:00:39.486765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.486731    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:39.486825 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.486801    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:39.486874 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.486836    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:39.546074 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.546037    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"]
Oct 30 22:00:39.555799 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.552647    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:39.555799 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.552770    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:39.555799 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.552815    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:39.800710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.800510    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" event={"ID":"ddc604a8-e33e-4237-b434-95a33c21b8aa","Type":"ContainerStarted","Data":"2471cf1dab30bb92859f5e8874581865b7a9ecf468bace4b7a91412db6c077a8"}
Oct 30 22:00:39.800710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.800559    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" event={"ID":"ddc604a8-e33e-4237-b434-95a33c21b8aa","Type":"ContainerStarted","Data":"f68640a72f2af84efe3dd23a2690eea9de20c72e06bb26a96b7c5b5dbbda058a"}
Oct 30 22:00:39.802673 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.802647    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" event={"ID":"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c","Type":"ContainerStarted","Data":"5f80a305e03a9d6654bd639dd83dfe68d039fd48b72f8ed9b2a92994989b7b3c"}
Oct 30 22:00:39.802823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.802684    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" event={"ID":"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c","Type":"ContainerStarted","Data":"7d04c6ca7240fcdf2204db6154316acaf2e03b3b872f2f515c8e4531512bbb32"}
Oct 30 22:00:39.995427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:39.995394    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:40.060831 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.060745    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:40.063348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.063090    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 22:00:40.063348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.063157    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 22:00:40.064863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.064821    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podStartSLOduration=2.064807097 podStartE2EDuration="2.064807097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:39.940499776 +0000 UTC m=+2240.972348306" watchObservedRunningTime="2026-10-30 22:00:40.064807097 +0000 UTC m=+2241.096655631"
Oct 30 22:00:40.066908 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.065864    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" podStartSLOduration=2.065853611 podStartE2EDuration="2.065853611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:40.063350025 +0000 UTC m=+2241.095198572" watchObservedRunningTime="2026-10-30 22:00:40.065853611 +0000 UTC m=+2241.097702146"
Oct 30 22:00:40.483092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.482210    5575 patch_prober.go:29] interesting pod/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 22:00:40.483092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.482273    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 22:00:40.501537 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.501458    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:40.965992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.957485    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:40.997860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.997823    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 22:00:40.998121 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:40.998076    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 22:00:41.076992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:41.069311    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 22:00:41.076992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:41.069395    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 22:00:41.460992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:41.460361    5575 patch_prober.go:29] interesting pod/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 22:00:41.460992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:41.460429    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 22:00:41.831051 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:41.805875    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:42.029013 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.003134    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 22:00:42.029013 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.003195    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 22:00:42.105050 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.101336    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 22:00:42.105050 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.101390    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 22:00:42.135988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.127691    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:42.457003 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.454469    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:42.457003 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.454568    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 22:00:42.464990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.461253    5575 patch_prober.go:29] interesting pod/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 22:00:42.464990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.461303    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 22:00:42.693993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.693065    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:00:42.798053 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.797528    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:00:42.876993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.876319    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f" podUID="5550810b-b9ac-4e61-a2de-c00bec116d9f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:00:42.913047 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.910055    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:00:42.913047 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.910450    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 22:00:42.913047 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:42.911602    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:00:43.000551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.000511    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 22:00:43.000752 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.000576    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 22:00:43.077045 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.076644    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 22:00:43.077045 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.076713    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 22:00:43.119704 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.115192    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 22:00:43.258994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.258055    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:00:43.293993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.290934    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:00:43.471479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.471442    5575 patch_prober.go:29] interesting pod/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 22:00:43.471757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.471729    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 22:00:43.995114 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.995079    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 22:00:43.995279 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:43.995129    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 22:00:44.065994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:44.062435    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 22:00:44.065994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:44.062491    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 22:00:44.475250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:44.475218    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 22:00:44.477376 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:44.477354    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 22:00:44.478881 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:44.478831    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 22:00:44.995453 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:44.995414    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 22:00:44.995660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:44.995479    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 22:00:45.069892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:45.069727    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 22:00:45.069892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:45.069814    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 22:00:45.466993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:45.466037    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:45.995479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:45.995442    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 22:00:45.995881 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:45.995506    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 22:00:46.061993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:46.061258    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 22:00:46.061993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:46.061315    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 22:00:47.396250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:47.396213    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:47.397808 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:47.397352    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:47.398340 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:47.398307    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:00:47.462012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:47.459984    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:47.462012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:47.461627    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:47.463880 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:47.463832    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:00:47.757652 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:47.757568    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:47.783726 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:47.783697    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:00:50.660681 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:50.660641    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:52.693217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:52.693183    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:53.489255 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:00:53.489224    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:00:53.773220 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:53.773129    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:56.325139 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:56.325105    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:56.509772 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:56.509739    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:56.679426 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:56.679395    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:57.801451 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:57.801417    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:59.644891 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:59.644819    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:59.830038 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:00:59.829956    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:00.337674 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.337646    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"]
Oct 30 22:01:00.350266 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.350219    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:00.353028 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.350078    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"]
Oct 30 22:01:00.404066 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.404037    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-ea1f0b\""
Oct 30 22:01:00.432047 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.432009    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9r5l\" (UniqueName: \"kubernetes.io/projected/3b5bf0cd-0842-4ee6-afd7-61983326f113-kube-api-access-c9r5l\") pod \"payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm\" (UID: \"3b5bf0cd-0842-4ee6-afd7-61983326f113\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:00.432210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.432088    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5bf0cd-0842-4ee6-afd7-61983326f113-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm\" (UID: \"3b5bf0cd-0842-4ee6-afd7-61983326f113\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:00.453330 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.453303    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-ea1f0b-dockercfg-9zk6x\""
Oct 30 22:01:00.533627 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.533592    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9r5l\" (UniqueName: \"kubernetes.io/projected/3b5bf0cd-0842-4ee6-afd7-61983326f113-kube-api-access-c9r5l\") pod \"payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm\" (UID: \"3b5bf0cd-0842-4ee6-afd7-61983326f113\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:00.533786 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.533657    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5bf0cd-0842-4ee6-afd7-61983326f113-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm\" (UID: \"3b5bf0cd-0842-4ee6-afd7-61983326f113\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:00.534435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.534416    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5bf0cd-0842-4ee6-afd7-61983326f113-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm\" (UID: \"3b5bf0cd-0842-4ee6-afd7-61983326f113\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:00.595710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.595639    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9r5l\" (UniqueName: \"kubernetes.io/projected/3b5bf0cd-0842-4ee6-afd7-61983326f113-kube-api-access-c9r5l\") pod \"payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm\" (UID: \"3b5bf0cd-0842-4ee6-afd7-61983326f113\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:00.677263 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:00.677232    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:01.060228 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:01:01.060188    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5bf0cd_0842_4ee6_afd7_61983326f113.slice/crio-50088ad334a5e4c4dc501cd86e34101eeb43fe92b8ba7738f1ac850e9023cd74 WatchSource:0}: Error finding container 50088ad334a5e4c4dc501cd86e34101eeb43fe92b8ba7738f1ac850e9023cd74: Status 404 returned error can't find the container with id 50088ad334a5e4c4dc501cd86e34101eeb43fe92b8ba7738f1ac850e9023cd74
Oct 30 22:01:01.060354 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:01.060279    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"]
Oct 30 22:01:01.386551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:01.386519    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm" event={"ID":"3b5bf0cd-0842-4ee6-afd7-61983326f113","Type":"ContainerStarted","Data":"e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde"}
Oct 30 22:01:01.386731 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:01.386575    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm" event={"ID":"3b5bf0cd-0842-4ee6-afd7-61983326f113","Type":"ContainerStarted","Data":"50088ad334a5e4c4dc501cd86e34101eeb43fe92b8ba7738f1ac850e9023cd74"}
Oct 30 22:01:01.386731 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:01.386605    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:01.506584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:01.506532    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm" podStartSLOduration=1.5065173170000001 podStartE2EDuration="1.506517317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:01.50295683 +0000 UTC m=+2262.534805365" watchObservedRunningTime="2026-10-30 22:01:01.506517317 +0000 UTC m=+2262.538365851"
Oct 30 22:01:03.265611 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:03.265572    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:07.217045 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:07.216997    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:08.507810 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:08.507760    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:11.600261 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:11.600222    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"]
Oct 30 22:01:11.716629 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:11.716588    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"]
Oct 30 22:01:12.005327 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:12.005288    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:12.213344 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:12.213304    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:12.397775 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:12.397750    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:01:13.706688 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:13.706653    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:16.601444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:16.601374    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4" podUID="840f7e5a-4dca-4543-b75a-a6844d736985" containerName="payload-processing" containerID="cri-o://79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947" gracePeriod=25
Oct 30 22:01:16.719394 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:16.719351    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm" podUID="2eefa3b9-f854-4f44-9f60-a1fec407dfb5" containerName="payload-pre-processing" containerID="cri-o://b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818" gracePeriod=25
Oct 30 22:01:16.900014 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:16.899981    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 22:01:17.020250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.019173    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/840f7e5a-4dca-4543-b75a-a6844d736985-kube-api-access-lcz82\" (UniqueName: \"kubernetes.io/projected/840f7e5a-4dca-4543-b75a-a6844d736985-kube-api-access-lcz82\") pod \"840f7e5a-4dca-4543-b75a-a6844d736985\" (UID: \"840f7e5a-4dca-4543-b75a-a6844d736985\") "
Oct 30 22:01:17.020250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.019378    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/840f7e5a-4dca-4543-b75a-a6844d736985-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/840f7e5a-4dca-4543-b75a-a6844d736985-plugins-config-volume\") pod \"840f7e5a-4dca-4543-b75a-a6844d736985\" (UID: \"840f7e5a-4dca-4543-b75a-a6844d736985\") "
Oct 30 22:01:17.021114 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.021074    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840f7e5a-4dca-4543-b75a-a6844d736985-plugins-config-volume" pod "840f7e5a-4dca-4543-b75a-a6844d736985" (UID: "840f7e5a-4dca-4543-b75a-a6844d736985"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:01:17.023265 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.023180    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840f7e5a-4dca-4543-b75a-a6844d736985-kube-api-access-lcz82" pod "840f7e5a-4dca-4543-b75a-a6844d736985" (UID: "840f7e5a-4dca-4543-b75a-a6844d736985"). InnerVolumeSpecName "kube-api-access-lcz82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:01:17.032329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.032302    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 22:01:17.121385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.121298    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-kube-api-access-wsszb\" (UniqueName: \"kubernetes.io/projected/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-kube-api-access-wsszb\") pod \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\" (UID: \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\") "
Oct 30 22:01:17.121562 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.121411    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-plugins-config-volume\") pod \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\" (UID: \"2eefa3b9-f854-4f44-9f60-a1fec407dfb5\") "
Oct 30 22:01:17.121777 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.121753    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-plugins-config-volume" pod "2eefa3b9-f854-4f44-9f60-a1fec407dfb5" (UID: "2eefa3b9-f854-4f44-9f60-a1fec407dfb5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:01:17.122006 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.121987    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcz82\" (UniqueName: \"kubernetes.io/projected/840f7e5a-4dca-4543-b75a-a6844d736985-kube-api-access-lcz82\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:17.122151 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.122007    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:17.122151 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.122017    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/840f7e5a-4dca-4543-b75a-a6844d736985-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:17.124119 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.124099    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-kube-api-access-wsszb" pod "2eefa3b9-f854-4f44-9f60-a1fec407dfb5" (UID: "2eefa3b9-f854-4f44-9f60-a1fec407dfb5"). InnerVolumeSpecName "kube-api-access-wsszb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:01:17.223722 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.223642    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsszb\" (UniqueName: \"kubernetes.io/projected/2eefa3b9-f854-4f44-9f60-a1fec407dfb5-kube-api-access-wsszb\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:17.534654 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.534625    5575 generic.go:356] "Generic (PLEG): container finished" podID="840f7e5a-4dca-4543-b75a-a6844d736985" containerID="79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947" exitCode=0
Oct 30 22:01:17.534857 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.534667    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"
Oct 30 22:01:17.534857 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.534704    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4" event={"ID":"840f7e5a-4dca-4543-b75a-a6844d736985","Type":"ContainerDied","Data":"79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947"}
Oct 30 22:01:17.534857 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.534767    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4" event={"ID":"840f7e5a-4dca-4543-b75a-a6844d736985","Type":"ContainerDied","Data":"965ad4329946b55acca2f7665763973258c78a4832dc39fff7b04436dbd87edd"}
Oct 30 22:01:17.534857 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.534798    5575 scope.go:122] "RemoveContainer" containerID="79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947"
Oct 30 22:01:17.536274 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.536252    5575 generic.go:356] "Generic (PLEG): container finished" podID="2eefa3b9-f854-4f44-9f60-a1fec407dfb5" containerID="b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818" exitCode=0
Oct 30 22:01:17.536415 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.536288    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"
Oct 30 22:01:17.536415 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.536306    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm" event={"ID":"2eefa3b9-f854-4f44-9f60-a1fec407dfb5","Type":"ContainerDied","Data":"b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818"}
Oct 30 22:01:17.536415 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.536338    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm" event={"ID":"2eefa3b9-f854-4f44-9f60-a1fec407dfb5","Type":"ContainerDied","Data":"bda7c72d279022edd67b2f26566175cb6fad49052edeabf3d69c147840736122"}
Oct 30 22:01:17.550055 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.550020    5575 scope.go:122] "RemoveContainer" containerID="79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947"
Oct 30 22:01:17.550393 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:01:17.550371    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947\": container with ID starting with 79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947 not found: ID does not exist" containerID="79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947"
Oct 30 22:01:17.550478 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.550399    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947"} err="failed to get container status \"79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947\": rpc error: code = NotFound desc = could not find container \"79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947\": container with ID starting with 79a729c6d3d85d0e82e5345a3515112e6b16925a2d0b62ced2ce86c92a3ca947 not found: ID does not exist"
Oct 30 22:01:17.550478 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.550423    5575 scope.go:122] "RemoveContainer" containerID="b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818"
Oct 30 22:01:17.560708 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.560685    5575 scope.go:122] "RemoveContainer" containerID="b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818"
Oct 30 22:01:17.561037 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:01:17.561015    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818\": container with ID starting with b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818 not found: ID does not exist" containerID="b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818"
Oct 30 22:01:17.561135 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.561049    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818"} err="failed to get container status \"b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818\": rpc error: code = NotFound desc = could not find container \"b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818\": container with ID starting with b19d16d4641e8d6e60e090895bc06f587f74f5804adeaedd3974e2b98edf8818 not found: ID does not exist"
Oct 30 22:01:17.707245 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.707210    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"]
Oct 30 22:01:17.757370 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.757341    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-71a3d788-5d9458d79-gb6nm"]
Oct 30 22:01:17.870318 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.870246    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"]
Oct 30 22:01:17.878955 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:17.878927    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-71a3d788-55b8b7f8bb-94mn4"]
Oct 30 22:01:18.799280 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:18.799241    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:19.145209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:19.145177    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2eefa3b9-f854-4f44-9f60-a1fec407dfb5" path="/var/lib/kubelet/pods/2eefa3b9-f854-4f44-9f60-a1fec407dfb5/volumes"
Oct 30 22:01:19.145662 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:19.145640    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="840f7e5a-4dca-4543-b75a-a6844d736985" path="/var/lib/kubelet/pods/840f7e5a-4dca-4543-b75a-a6844d736985/volumes"
Oct 30 22:01:23.486500 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:01:23.486455    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:01:23.834197 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.834116    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"]
Oct 30 22:01:23.835269 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.835249    5575 cpu_manager.go:414] "containerMap: removing container" podUID="2eefa3b9-f854-4f44-9f60-a1fec407dfb5" containerName="payload-pre-processing"
Oct 30 22:01:23.835334 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.835274    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2eefa3b9-f854-4f44-9f60-a1fec407dfb5" containerName="payload-pre-processing"
Oct 30 22:01:23.835334 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.835292    5575 cpu_manager.go:414] "containerMap: removing container" podUID="840f7e5a-4dca-4543-b75a-a6844d736985" containerName="payload-processing"
Oct 30 22:01:23.835334 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.835300    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="840f7e5a-4dca-4543-b75a-a6844d736985" containerName="payload-processing"
Oct 30 22:01:23.835500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.835488    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="2eefa3b9-f854-4f44-9f60-a1fec407dfb5" containerName="payload-pre-processing"
Oct 30 22:01:23.835537 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.835508    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="840f7e5a-4dca-4543-b75a-a6844d736985" containerName="payload-processing"
Oct 30 22:01:23.841504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.841481    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.861486 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.861461    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef04870-4eb9-4a6a-b289-a01028fca172-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.861603 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.861496    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb8ql\" (UniqueName: \"kubernetes.io/projected/eef04870-4eb9-4a6a-b289-a01028fca172-kube-api-access-tb8ql\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.861603 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.861527    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.861790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.861770    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-metrics-certs\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.900078 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.900048    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"]
Oct 30 22:01:23.944251 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.944175    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e6dcc0-serving-cert\""
Oct 30 22:01:23.963249 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.963223    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef04870-4eb9-4a6a-b289-a01028fca172-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.963417 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.963259    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb8ql\" (UniqueName: \"kubernetes.io/projected/eef04870-4eb9-4a6a-b289-a01028fca172-kube-api-access-tb8ql\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.963417 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.963295    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.963417 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.963401    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-metrics-certs\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.963607 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:01:23.963460    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-serving-cert: secret "maas-api-e2e-inf-a-e6dcc0-serving-cert" not found
Oct 30 22:01:23.963607 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:01:23.963564    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls podName:eef04870-4eb9-4a6a-b289-a01028fca172 nodeName:}" failed. No retries permitted until 2026-10-30 22:01:24.463540111 +0000 UTC m=+2285.495388629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls") pod "maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs" (UID: "eef04870-4eb9-4a6a-b289-a01028fca172") : secret "maas-api-e2e-inf-a-e6dcc0-serving-cert" not found
Oct 30 22:01:23.964014 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.963989    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef04870-4eb9-4a6a-b289-a01028fca172-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:23.966044 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:23.966024    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-metrics-certs\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:24.054579 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:24.054540    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb8ql\" (UniqueName: \"kubernetes.io/projected/eef04870-4eb9-4a6a-b289-a01028fca172-kube-api-access-tb8ql\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:24.098634 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:24.098552    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:24.262837 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:24.262748    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:24.423881 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:24.423850    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:24.470828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:24.470801    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:24.473377 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:24.473349    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls\") pod \"maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:24.758607 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:24.758534    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:25.159678 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:01:25.159646    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef04870_4eb9_4a6a_b289_a01028fca172.slice/crio-4187a6fcf6348ba2164ef0a877f77fadfa67e2865c644ca3d58c7d0209857dd1 WatchSource:0}: Error finding container 4187a6fcf6348ba2164ef0a877f77fadfa67e2865c644ca3d58c7d0209857dd1: Status 404 returned error can't find the container with id 4187a6fcf6348ba2164ef0a877f77fadfa67e2865c644ca3d58c7d0209857dd1
Oct 30 22:01:25.160742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:25.160702    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"]
Oct 30 22:01:25.607587 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:25.607499    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs" event={"ID":"eef04870-4eb9-4a6a-b289-a01028fca172","Type":"ContainerStarted","Data":"4187a6fcf6348ba2164ef0a877f77fadfa67e2865c644ca3d58c7d0209857dd1"}
Oct 30 22:01:26.619520 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:26.619474    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs" event={"ID":"eef04870-4eb9-4a6a-b289-a01028fca172","Type":"ContainerStarted","Data":"4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a"}
Oct 30 22:01:26.620092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:26.619653    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:26.765292 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:26.765229    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs" podStartSLOduration=2.943118369 podStartE2EDuration="3.765214941s" totalImagesPullingTime="822.096572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:26.763518133 +0000 UTC m=+2287.795366667" watchObservedRunningTime="2026-10-30 22:01:26.765214941 +0000 UTC m=+2287.797063476"
Oct 30 22:01:28.649954 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:28.649923    5575 generic.go:356] "Generic (PLEG): container finished" podID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerID="0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf" exitCode=0
Oct 30 22:01:28.650423 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:28.650002    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" event={"ID":"61c0d99c-0998-48b5-9367-ef699d3608c7","Type":"ContainerDied","Data":"0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf"}
Oct 30 22:01:28.650529 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:28.650497    5575 scope.go:122] "RemoveContainer" containerID="0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf"
Oct 30 22:01:28.652344 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:28.652314    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:01:28.652462 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:28.652399    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:01:28.652462 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:28.652449    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:01:29.332490 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:29.332442    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:29.659873 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:29.659842    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" event={"ID":"61c0d99c-0998-48b5-9367-ef699d3608c7","Type":"ContainerStarted","Data":"725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e"}
Oct 30 22:01:29.689725 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:29.689689    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:29.891138 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:29.891098    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:30.380622 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:30.380586    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 22:01:30.381603 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:30.381575    5575 patch_prober.go:29] interesting pod/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:01:30.381757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:30.381634    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:01:30.571420 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:30.571383    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:30.831849 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:30.831817    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:31.380092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:31.380055    5575 patch_prober.go:29] interesting pod/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:01:31.380360 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:31.380326    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:01:32.380618 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:32.380585    5575 patch_prober.go:29] interesting pod/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:01:32.381043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:32.380645    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:01:32.642465 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:32.642436    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:01:33.380203 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:33.380161    5575 patch_prober.go:29] interesting pod/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:01:33.380390 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:33.380228    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:01:34.105660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.105630    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 22:01:34.380580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.380497    5575 patch_prober.go:29] interesting pod/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:01:34.380580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.380554    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:01:34.684945 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.684912    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"]
Oct 30 22:01:34.689737 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.689719    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.796108 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.796077    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-98d38f-serving-cert\""
Oct 30 22:01:34.802479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.802395    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"]
Oct 30 22:01:34.850787 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.850746    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce56670-6071-44a1-a588-9fa0f0a34598-openshift-service-ca\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.851130 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.851104    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.851330 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.851312    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqpd9\" (UniqueName: \"kubernetes.io/projected/6ce56670-6071-44a1-a588-9fa0f0a34598-kube-api-access-nqpd9\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.851474 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.851459    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-metrics-certs\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.936235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.936137    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:34.953699 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.953661    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce56670-6071-44a1-a588-9fa0f0a34598-openshift-service-ca\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.953893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.953742    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.953893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.953821    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqpd9\" (UniqueName: \"kubernetes.io/projected/6ce56670-6071-44a1-a588-9fa0f0a34598-kube-api-access-nqpd9\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.953893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.953875    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-metrics-certs\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.954252 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:01:34.954231    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-serving-cert: secret "maas-api-e2e-api-a-98d38f-serving-cert" not found
Oct 30 22:01:34.954421 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:01:34.954401    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls podName:6ce56670-6071-44a1-a588-9fa0f0a34598 nodeName:}" failed. No retries permitted until 2026-10-30 22:01:35.454374778 +0000 UTC m=+2296.486223308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls") pod "maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5" (UID: "6ce56670-6071-44a1-a588-9fa0f0a34598") : secret "maas-api-e2e-api-a-98d38f-serving-cert" not found
Oct 30 22:01:34.955007 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.954982    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce56670-6071-44a1-a588-9fa0f0a34598-openshift-service-ca\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:34.967015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:34.962298    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-metrics-certs\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:35.028872 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:35.028637    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqpd9\" (UniqueName: \"kubernetes.io/projected/6ce56670-6071-44a1-a588-9fa0f0a34598-kube-api-access-nqpd9\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:35.090890 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:35.090849    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:35.253314 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:35.250742    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:35.385857 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:35.385825    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 22:01:35.387250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:35.387216    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 22:01:35.465297 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:35.465262    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:35.468250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:35.468221    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls\") pod \"maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:35.604848 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:35.604760    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:36.009091 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:36.009058    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"]
Oct 30 22:01:36.011909 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:01:36.011880    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce56670_6071_44a1_a588_9fa0f0a34598.slice/crio-7231ef6296a41e653101a78e68e4c842bdfc5250a22d30be24c0ec9b9e4957bf WatchSource:0}: Error finding container 7231ef6296a41e653101a78e68e4c842bdfc5250a22d30be24c0ec9b9e4957bf: Status 404 returned error can't find the container with id 7231ef6296a41e653101a78e68e4c842bdfc5250a22d30be24c0ec9b9e4957bf
Oct 30 22:01:36.805932 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:36.805894    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5" event={"ID":"6ce56670-6071-44a1-a588-9fa0f0a34598","Type":"ContainerStarted","Data":"7231ef6296a41e653101a78e68e4c842bdfc5250a22d30be24c0ec9b9e4957bf"}
Oct 30 22:01:37.816182 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:37.816146    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5" event={"ID":"6ce56670-6071-44a1-a588-9fa0f0a34598","Type":"ContainerStarted","Data":"a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194"}
Oct 30 22:01:37.816569 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:37.816204    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:37.938632 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:37.938568    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5" podStartSLOduration=3.134349907 podStartE2EDuration="3.938545292s" totalImagesPullingTime="804.195385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:37.937049809 +0000 UTC m=+2298.968898345" watchObservedRunningTime="2026-10-30 22:01:37.938545292 +0000 UTC m=+2298.970393846"
Oct 30 22:01:39.979345 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:39.979310    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:40.138976 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:40.138932    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:40.299680 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:40.299592    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:42.912745 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:42.912033    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:43.076959 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:43.076924    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:43.829893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:43.829855    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:01:44.050621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:44.050582    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:44.297684 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:44.297649    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:45.040172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:45.040132    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:45.901706 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:45.901666    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:46.380282 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:46.380205    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"]
Oct 30 22:01:46.380441 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:46.380416    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy" containerID="cri-o://bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a" gracePeriod=30
Oct 30 22:01:46.857375 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:46.857341    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:47.226932 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:47.226895    5575 patch_prober.go:29] interesting pod/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:01:47.227387 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:47.226961    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:01:49.981471 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:49.981434    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:50.628580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:50.628540    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:51.682433 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.682406    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 22:01:51.808162 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808118    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-token\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-token\") pod \"7c2e13ac-08d3-4dde-9264-a40bad982399\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") "
Oct 30 22:01:51.808361 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808205    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-envoy\") pod \"7c2e13ac-08d3-4dde-9264-a40bad982399\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") "
Oct 30 22:01:51.808361 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808248    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-data\") pod \"7c2e13ac-08d3-4dde-9264-a40bad982399\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") "
Oct 30 22:01:51.808361 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808282    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c2e13ac-08d3-4dde-9264-a40bad982399-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2e13ac-08d3-4dde-9264-a40bad982399-istiod-ca-cert\") pod \"7c2e13ac-08d3-4dde-9264-a40bad982399\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") "
Oct 30 22:01:51.808534 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808377    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-podinfo\") pod \"7c2e13ac-08d3-4dde-9264-a40bad982399\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") "
Oct 30 22:01:51.808607 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808548    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-credential-socket\") pod \"7c2e13ac-08d3-4dde-9264-a40bad982399\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") "
Oct 30 22:01:51.808607 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808593    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-data" pod "7c2e13ac-08d3-4dde-9264-a40bad982399" (UID: "7c2e13ac-08d3-4dde-9264-a40bad982399"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:01:51.808731 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808713    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-certs\") pod \"7c2e13ac-08d3-4dde-9264-a40bad982399\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") "
Oct 30 22:01:51.808809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808789    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-socket\") pod \"7c2e13ac-08d3-4dde-9264-a40bad982399\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") "
Oct 30 22:01:51.808905 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.808873    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-kube-api-access-6n8hx\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-kube-api-access-6n8hx\") pod \"7c2e13ac-08d3-4dde-9264-a40bad982399\" (UID: \"7c2e13ac-08d3-4dde-9264-a40bad982399\") "
Oct 30 22:01:51.809107 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.809030    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-credential-socket" pod "7c2e13ac-08d3-4dde-9264-a40bad982399" (UID: "7c2e13ac-08d3-4dde-9264-a40bad982399"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:01:51.809175 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.809107    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c2e13ac-08d3-4dde-9264-a40bad982399-istiod-ca-cert" pod "7c2e13ac-08d3-4dde-9264-a40bad982399" (UID: "7c2e13ac-08d3-4dde-9264-a40bad982399"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:01:51.809237 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.809216    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-socket" pod "7c2e13ac-08d3-4dde-9264-a40bad982399" (UID: "7c2e13ac-08d3-4dde-9264-a40bad982399"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:01:51.809678 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.809597    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:51.809678 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.809624    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2e13ac-08d3-4dde-9264-a40bad982399-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:51.809678 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.809641    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:51.809678 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.809656    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:51.810217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.809838    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-certs" pod "7c2e13ac-08d3-4dde-9264-a40bad982399" (UID: "7c2e13ac-08d3-4dde-9264-a40bad982399"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:01:51.810760 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.810734    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-token" pod "7c2e13ac-08d3-4dde-9264-a40bad982399" (UID: "7c2e13ac-08d3-4dde-9264-a40bad982399"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:01:51.811051 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.811029    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-envoy" pod "7c2e13ac-08d3-4dde-9264-a40bad982399" (UID: "7c2e13ac-08d3-4dde-9264-a40bad982399"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:01:51.811537 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.811515    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-kube-api-access-6n8hx" pod "7c2e13ac-08d3-4dde-9264-a40bad982399" (UID: "7c2e13ac-08d3-4dde-9264-a40bad982399"). InnerVolumeSpecName "kube-api-access-6n8hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:01:51.811977 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.811945    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-podinfo" pod "7c2e13ac-08d3-4dde-9264-a40bad982399" (UID: "7c2e13ac-08d3-4dde-9264-a40bad982399"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:01:51.911564 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.911482    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:51.911564 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.911513    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:51.911564 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.911523    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2e13ac-08d3-4dde-9264-a40bad982399-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:51.911564 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.911531    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2e13ac-08d3-4dde-9264-a40bad982399-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:51.911564 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.911542    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n8hx\" (UniqueName: \"kubernetes.io/projected/7c2e13ac-08d3-4dde-9264-a40bad982399-kube-api-access-6n8hx\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:51.951516 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.951478    5575 generic.go:356] "Generic (PLEG): container finished" podID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerID="bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a" exitCode=0
Oct 30 22:01:51.951719 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.951553    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"
Oct 30 22:01:51.951719 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.951593    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" event={"ID":"7c2e13ac-08d3-4dde-9264-a40bad982399","Type":"ContainerDied","Data":"bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a"}
Oct 30 22:01:51.951719 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.951688    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk" event={"ID":"7c2e13ac-08d3-4dde-9264-a40bad982399","Type":"ContainerDied","Data":"8fce64f8b766b2edb8477b3a53ea4cc9a16c8921ef3084f7db72787e1acaeaa1"}
Oct 30 22:01:51.951719 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.951718    5575 scope.go:122] "RemoveContainer" containerID="bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a"
Oct 30 22:01:51.969139 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.969103    5575 scope.go:122] "RemoveContainer" containerID="bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a"
Oct 30 22:01:51.969572 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:01:51.969549    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a\": container with ID starting with bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a not found: ID does not exist" containerID="bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a"
Oct 30 22:01:51.969670 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:51.969585    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a"} err="failed to get container status \"bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a\": rpc error: code = NotFound desc = could not find container \"bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a\": container with ID starting with bda8bdaa3fd5eef0cf366f92a3af5476cc05c96c491606f7c39eb71bcebb0b8a not found: ID does not exist"
Oct 30 22:01:52.119073 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:52.119043    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"]
Oct 30 22:01:52.126308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:52.126277    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-qlqtk"]
Oct 30 22:01:53.131631 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:53.131597    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" path="/var/lib/kubelet/pods/7c2e13ac-08d3-4dde-9264-a40bad982399/volumes"
Oct 30 22:01:53.488766 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:01:53.488660    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:01:54.109048 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:54.109005    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:54.953979 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:54.953936    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:55.135530 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:55.135498    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:58.091930 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.091852    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:58.296132 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.295958    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:58.510718 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.510682    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"]
Oct 30 22:01:58.511813 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.511792    5575 cpu_manager.go:414] "containerMap: removing container" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy"
Oct 30 22:01:58.511873 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.511818    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy"
Oct 30 22:01:58.512041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.512028    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c2e13ac-08d3-4dde-9264-a40bad982399" containerName="istio-proxy"
Oct 30 22:01:58.516463 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.516440    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:01:58.571751 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.571724    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"]
Oct 30 22:01:58.776439 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.776347    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-abb526\""
Oct 30 22:01:58.790353 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.778148    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-abb526-dockercfg-hncr7\""
Oct 30 22:01:58.790353 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.787498    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91caf8c6-8a1e-4125-881f-2c95b5832283-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf\" (UID: \"91caf8c6-8a1e-4125-881f-2c95b5832283\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:01:58.790353 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.787560    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx22c\" (UniqueName: \"kubernetes.io/projected/91caf8c6-8a1e-4125-881f-2c95b5832283-kube-api-access-fx22c\") pod \"payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf\" (UID: \"91caf8c6-8a1e-4125-881f-2c95b5832283\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:01:58.803393 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.803367    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"]
Oct 30 22:01:58.806907 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.806885    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:01:58.809531 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.809505    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"]
Oct 30 22:01:58.888957 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.888932    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a714f1-f0e9-4139-8535-49cff452f67f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w\" (UID: \"04a714f1-f0e9-4139-8535-49cff452f67f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:01:58.889121 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.889101    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91caf8c6-8a1e-4125-881f-2c95b5832283-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf\" (UID: \"91caf8c6-8a1e-4125-881f-2c95b5832283\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:01:58.889168 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.889153    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx22c\" (UniqueName: \"kubernetes.io/projected/91caf8c6-8a1e-4125-881f-2c95b5832283-kube-api-access-fx22c\") pod \"payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf\" (UID: \"91caf8c6-8a1e-4125-881f-2c95b5832283\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:01:58.889227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.889214    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvtsv\" (UniqueName: \"kubernetes.io/projected/04a714f1-f0e9-4139-8535-49cff452f67f-kube-api-access-rvtsv\") pod \"payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w\" (UID: \"04a714f1-f0e9-4139-8535-49cff452f67f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:01:58.889799 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.889781    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91caf8c6-8a1e-4125-881f-2c95b5832283-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf\" (UID: \"91caf8c6-8a1e-4125-881f-2c95b5832283\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:01:58.952589 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.952559    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx22c\" (UniqueName: \"kubernetes.io/projected/91caf8c6-8a1e-4125-881f-2c95b5832283-kube-api-access-fx22c\") pod \"payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf\" (UID: \"91caf8c6-8a1e-4125-881f-2c95b5832283\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:01:58.990305 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.990274    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvtsv\" (UniqueName: \"kubernetes.io/projected/04a714f1-f0e9-4139-8535-49cff452f67f-kube-api-access-rvtsv\") pod \"payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w\" (UID: \"04a714f1-f0e9-4139-8535-49cff452f67f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:01:58.990415 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.990374    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a714f1-f0e9-4139-8535-49cff452f67f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w\" (UID: \"04a714f1-f0e9-4139-8535-49cff452f67f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:01:58.991039 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:58.991019    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a714f1-f0e9-4139-8535-49cff452f67f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w\" (UID: \"04a714f1-f0e9-4139-8535-49cff452f67f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:01:59.051675 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:59.051606    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvtsv\" (UniqueName: \"kubernetes.io/projected/04a714f1-f0e9-4139-8535-49cff452f67f-kube-api-access-rvtsv\") pod \"payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w\" (UID: \"04a714f1-f0e9-4139-8535-49cff452f67f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:01:59.124868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:59.124842    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:01:59.133264 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:59.133240    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:01:59.505958 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:59.505927    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"]
Oct 30 22:01:59.547177 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:01:59.547142    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a714f1_f0e9_4139_8535_49cff452f67f.slice/crio-4a97a8e8c9e7d1c4bc4bef4842bc8e02e3417c66e063b41a8c6a9a2030d90509 WatchSource:0}: Error finding container 4a97a8e8c9e7d1c4bc4bef4842bc8e02e3417c66e063b41a8c6a9a2030d90509: Status 404 returned error can't find the container with id 4a97a8e8c9e7d1c4bc4bef4842bc8e02e3417c66e063b41a8c6a9a2030d90509
Oct 30 22:01:59.561486 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:59.561456    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"]
Oct 30 22:01:59.562659 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:01:59.562625    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91caf8c6_8a1e_4125_881f_2c95b5832283.slice/crio-036410d5bca331e2e443a7db42be8846bfdd230a8a31fd06e1d06a766cd1cebd WatchSource:0}: Error finding container 036410d5bca331e2e443a7db42be8846bfdd230a8a31fd06e1d06a766cd1cebd: Status 404 returned error can't find the container with id 036410d5bca331e2e443a7db42be8846bfdd230a8a31fd06e1d06a766cd1cebd
Oct 30 22:01:59.668007 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:01:59.667945    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:00.035694 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:00.035659    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf" event={"ID":"91caf8c6-8a1e-4125-881f-2c95b5832283","Type":"ContainerStarted","Data":"d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff"}
Oct 30 22:02:00.036045 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:00.036022    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf" event={"ID":"91caf8c6-8a1e-4125-881f-2c95b5832283","Type":"ContainerStarted","Data":"036410d5bca331e2e443a7db42be8846bfdd230a8a31fd06e1d06a766cd1cebd"}
Oct 30 22:02:00.037286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:00.037261    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:02:00.039894 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:00.039872    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w" event={"ID":"04a714f1-f0e9-4139-8535-49cff452f67f","Type":"ContainerStarted","Data":"7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1"}
Oct 30 22:02:00.040167 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:00.040078    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w" event={"ID":"04a714f1-f0e9-4139-8535-49cff452f67f","Type":"ContainerStarted","Data":"4a97a8e8c9e7d1c4bc4bef4842bc8e02e3417c66e063b41a8c6a9a2030d90509"}
Oct 30 22:02:00.041282 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:00.041255    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:02:00.156944 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:00.156886    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf" podStartSLOduration=2.156872129 podStartE2EDuration="2.156872129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:00.153385293 +0000 UTC m=+2321.185233830" watchObservedRunningTime="2026-10-30 22:02:00.156872129 +0000 UTC m=+2321.188720664"
Oct 30 22:02:00.287239 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:00.287145    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w" podStartSLOduration=2.287131004 podStartE2EDuration="2.287131004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:00.286443575 +0000 UTC m=+2321.318292110" watchObservedRunningTime="2026-10-30 22:02:00.287131004 +0000 UTC m=+2321.318979579"
Oct 30 22:02:01.713560 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:01.713513    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:01.869842 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:01.869806    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:02.098045 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:02.097183    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:03.852141 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:03.852103    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:07.488423 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:07.488388    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:08.769227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:08.769189    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:12.072866 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:12.072832    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:02:12.079858 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:12.079836    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:02:12.768907 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:12.768825    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:13.052362 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:13.052287    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:13.189270 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:13.189234    5575 generic.go:356] "Generic (PLEG): container finished" podID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerID="8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a" exitCode=0
Oct 30 22:02:13.189666 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:13.189311    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" event={"ID":"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc","Type":"ContainerDied","Data":"8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a"}
Oct 30 22:02:13.189731 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:13.189705    5575 scope.go:122] "RemoveContainer" containerID="8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a"
Oct 30 22:02:13.191225 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:13.191196    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:02:13.191295 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:13.191264    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:02:13.191335 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:13.191297    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:02:13.799778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:13.799740    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"]
Oct 30 22:02:13.884263 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:13.884234    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:14.200752 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:14.200716    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" event={"ID":"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc","Type":"ContainerStarted","Data":"d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f"}
Oct 30 22:02:14.984468 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:14.984432    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:02:14.985672 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:14.985646    5575 patch_prober.go:29] interesting pod/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:02:14.985796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:14.985693    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:02:15.984943 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:15.984908    5575 patch_prober.go:29] interesting pod/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:02:15.985374 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:15.985000    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:02:16.984253 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:16.984218    5575 patch_prober.go:29] interesting pod/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:02:16.984427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:16.984277    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:02:17.533384 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:17.533341    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:02:17.814626 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:17.814528    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:17.984078 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:17.984047    5575 patch_prober.go:29] interesting pod/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:02:17.984258 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:17.984102    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:02:18.300365 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:18.300329    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:18.460173 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:18.460138    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:18.732992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:18.732072    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:18.984310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:18.984235    5575 patch_prober.go:29] interesting pod/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:02:18.984310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:18.984292    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:02:19.988702 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:19.988672    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:02:19.989756 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:19.989733    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:02:20.798497 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:20.798465    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:20.959653 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:20.959619    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:23.474762 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:23.474727    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:23.488322 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:02:23.488276    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:02:28.451382 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:28.451309    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:28.844700 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:28.844584    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main" containerID="cri-o://b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8" gracePeriod=45
Oct 30 22:02:29.140483 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.140459    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 22:02:29.239316 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.239289    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-dshm\") pod \"2e2b952f-4903-4c30-9ab7-058f17174990\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") "
Oct 30 22:02:29.239480 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.239358    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-model-cache\") pod \"2e2b952f-4903-4c30-9ab7-058f17174990\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") "
Oct 30 22:02:29.239480 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.239394    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-home\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-home\") pod \"2e2b952f-4903-4c30-9ab7-058f17174990\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") "
Oct 30 22:02:29.239480 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.239451    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e2b952f-4903-4c30-9ab7-058f17174990-kube-api-access-9qn79\" (UniqueName: \"kubernetes.io/projected/2e2b952f-4903-4c30-9ab7-058f17174990-kube-api-access-9qn79\") pod \"2e2b952f-4903-4c30-9ab7-058f17174990\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") "
Oct 30 22:02:29.239660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.239496    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-tmp-dir\") pod \"2e2b952f-4903-4c30-9ab7-058f17174990\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") "
Oct 30 22:02:29.239660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.239620    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e2b952f-4903-4c30-9ab7-058f17174990-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2b952f-4903-4c30-9ab7-058f17174990-tls-certs\") pod \"2e2b952f-4903-4c30-9ab7-058f17174990\" (UID: \"2e2b952f-4903-4c30-9ab7-058f17174990\") "
Oct 30 22:02:29.239751 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.239643    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-model-cache" pod "2e2b952f-4903-4c30-9ab7-058f17174990" (UID: "2e2b952f-4903-4c30-9ab7-058f17174990"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:02:29.239751 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.239714    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-home" pod "2e2b952f-4903-4c30-9ab7-058f17174990" (UID: "2e2b952f-4903-4c30-9ab7-058f17174990"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:02:29.239843 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.239830    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-tmp-dir" pod "2e2b952f-4903-4c30-9ab7-058f17174990" (UID: "2e2b952f-4903-4c30-9ab7-058f17174990"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:02:29.240198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.240180    5575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-tmp-dir\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:02:29.240198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.240198    5575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-model-cache\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:02:29.240344 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.240208    5575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-home\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:02:29.241580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.241559    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-dshm" pod "2e2b952f-4903-4c30-9ab7-058f17174990" (UID: "2e2b952f-4903-4c30-9ab7-058f17174990"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:02:29.241765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.241746    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2b952f-4903-4c30-9ab7-058f17174990-kube-api-access-9qn79" pod "2e2b952f-4903-4c30-9ab7-058f17174990" (UID: "2e2b952f-4903-4c30-9ab7-058f17174990"). InnerVolumeSpecName "kube-api-access-9qn79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:02:29.241877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.241863    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2b952f-4903-4c30-9ab7-058f17174990-tls-certs" pod "2e2b952f-4903-4c30-9ab7-058f17174990" (UID: "2e2b952f-4903-4c30-9ab7-058f17174990"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:02:29.343212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.343171    5575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2b952f-4903-4c30-9ab7-058f17174990-tls-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:02:29.343212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.343210    5575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2b952f-4903-4c30-9ab7-058f17174990-dshm\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:02:29.343461 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.343225    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qn79\" (UniqueName: \"kubernetes.io/projected/2e2b952f-4903-4c30-9ab7-058f17174990-kube-api-access-9qn79\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:02:29.350286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.350151    5575 generic.go:356] "Generic (PLEG): container finished" podID="2e2b952f-4903-4c30-9ab7-058f17174990" containerID="b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8" exitCode=0
Oct 30 22:02:29.350286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.350210    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"
Oct 30 22:02:29.350286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.350225    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" event={"ID":"2e2b952f-4903-4c30-9ab7-058f17174990","Type":"ContainerDied","Data":"b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8"}
Oct 30 22:02:29.350286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.350281    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f" event={"ID":"2e2b952f-4903-4c30-9ab7-058f17174990","Type":"ContainerDied","Data":"94fae98db6ce1d283ccab643ad3932907ea62cc59b15be12c93d09353a84f7ab"}
Oct 30 22:02:29.350632 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.350304    5575 scope.go:122] "RemoveContainer" containerID="b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8"
Oct 30 22:02:29.366599 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.366571    5575 scope.go:122] "RemoveContainer" containerID="b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8"
Oct 30 22:02:29.366879 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:02:29.366858    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8\": container with ID starting with b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8 not found: ID does not exist" containerID="b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8"
Oct 30 22:02:29.366957 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.366887    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8"} err="failed to get container status \"b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8\": rpc error: code = NotFound desc = could not find container \"b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8\": container with ID starting with b8cb1d702d3e4166512789f8ffc7ba36928ccaf93612287d72353e4d95b7b8f8 not found: ID does not exist"
Oct 30 22:02:29.518865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.518821    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"]
Oct 30 22:02:29.522652 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:29.522626    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-91874e/simulator-w2-91874e-kserve-5dcc766969-v759f"]
Oct 30 22:02:31.130541 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:31.130497    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" path="/var/lib/kubelet/pods/2e2b952f-4903-4c30-9ab7-058f17174990/volumes"
Oct 30 22:02:33.226462 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:33.226427    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:38.091016 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:38.090923    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:43.185830 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:43.185798    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:48.299516 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:48.299478    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:49.871513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:49.871480    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:50.129987 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:50.129848    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:50.302325 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:50.302290    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:50.476189 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:50.476158    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:51.167141 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:51.167100    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:51.492218 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:51.492120    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:52.302105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:52.302075    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:53.487863 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:02:53.487816    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:02:53.873352 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:53.873272    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:54.477475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:54.477433    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:55.138397 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:55.138300    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:55.603128 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:55.603022    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:55.930284 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:55.930253    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:56.130058 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:56.130020    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:56.321762 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:56.321660    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:58.381242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:58.381209    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:58.555988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:58.545003    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:59.210344 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:59.210308    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:59.433862 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:59.433832    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:59.596128 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:02:59.596046    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:01.984529 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:01.984497    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:02.792387 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:02.792353    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:03.698287 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:03.698258    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:04.611211 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:04.611176    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:04.786286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:04.786255    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:05.347935 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:05.347901    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:06.717453 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:06.717416    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:07.489222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:07.489190    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:08.046260 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.046225    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"]
Oct 30 22:03:08.046981 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.046948    5575 cpu_manager.go:414] "containerMap: removing container" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main"
Oct 30 22:03:08.046981 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.046977    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main"
Oct 30 22:03:08.047095 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.047086    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e2b952f-4903-4c30-9ab7-058f17174990" containerName="main"
Oct 30 22:03:08.051115 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.051091    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.108729 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.108695    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5a19c1-openshift-default-dockercfg-vzwhr\""
Oct 30 22:03:08.236990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.228484    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:08.255994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.235029    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"]
Oct 30 22:03:08.366370 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.366291    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-certs\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.366370 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.366346    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istiod-ca-cert\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.366619 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.366519    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-data\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.366619 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.366566    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9x9k\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-kube-api-access-x9x9k\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.366732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.366633    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-envoy\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.366732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.366677    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-credential-socket\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.366732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.366699    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-podinfo\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.366888 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.366830    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-token\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.366945 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.366894    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-socket\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468392    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-certs\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468433    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istiod-ca-cert\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468510    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-data\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468539    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9x9k\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-kube-api-access-x9x9k\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468598    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-envoy\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468883 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468632    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-credential-socket\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468883 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468653    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-podinfo\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468883 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468696    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-token\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468883 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468773    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-socket\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.468883 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468859    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-certs\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.469209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.468918    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-data\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.469209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.469121    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-credential-socket\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.469209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.469161    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-socket\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.469335 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.469316    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istiod-ca-cert\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.471179 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.471158    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-envoy\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.471640 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.471621    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-podinfo\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.530298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.530268    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-token\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.530505 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.530482    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9x9k\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-kube-api-access-x9x9k\") pod \"e2e-api-b-5a19c1-openshift-default-d646647-ldfmr\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") " pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.666889 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.666852    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:08.673850 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.673825    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:08.839181 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:08.839140    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:09.014755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:09.014666    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:09.111324 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:09.111299    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"]
Oct 30 22:03:09.112202 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:03:09.112175    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f98a0ba_90a8_4d14_bc04_f8b2fd593bdf.slice/crio-9462dbd181bd8ffaa53b1c8f07c6648ce08092da3e213027f14900d2e84abf65 WatchSource:0}: Error finding container 9462dbd181bd8ffaa53b1c8f07c6648ce08092da3e213027f14900d2e84abf65: Status 404 returned error can't find the container with id 9462dbd181bd8ffaa53b1c8f07c6648ce08092da3e213027f14900d2e84abf65
Oct 30 22:03:09.115795 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:09.115763    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:03:09.115896 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:09.115848    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:03:09.115961 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:09.115893    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:03:09.186801 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:09.186766    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:09.817452 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:09.817405    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" event={"ID":"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf","Type":"ContainerStarted","Data":"618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b"}
Oct 30 22:03:09.817685 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:09.817519    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" event={"ID":"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf","Type":"ContainerStarted","Data":"9462dbd181bd8ffaa53b1c8f07c6648ce08092da3e213027f14900d2e84abf65"}
Oct 30 22:03:09.997828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:09.997772    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" podStartSLOduration=2.997758855 podStartE2EDuration="2.997758855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:09.993353196 +0000 UTC m=+2391.025201742" watchObservedRunningTime="2026-10-30 22:03:09.997758855 +0000 UTC m=+2391.029607390"
Oct 30 22:03:10.667535 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:10.667484    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:10.673368 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:10.673342    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:10.826548 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:10.826516    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:10.827567 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:10.827545    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:03:10.905979 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:10.905928    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:12.219326 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:12.219281    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:12.421220 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:12.421191    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:12.778502 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:12.778468    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:13.659049 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:13.659007    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:13.838870 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:13.838835    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:14.046309 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:14.046222    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:14.206697 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:14.206658    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:16.044008 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.043949    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"]
Oct 30 22:03:16.048526 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.048504    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.101513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.101485    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-abb526-serving-cert\""
Oct 30 22:03:16.107024 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.106979    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"]
Oct 30 22:03:16.205226 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.205195    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9ae8fd-00e6-48cd-8802-753647bad014-openshift-service-ca\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.205411 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.205257    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-metrics-certs\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.205473 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.205407    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.205516 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.205490    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2bk4\" (UniqueName: \"kubernetes.io/projected/de9ae8fd-00e6-48cd-8802-753647bad014-kube-api-access-j2bk4\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.289995 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.289936    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:16.306500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.306437    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.306500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.306496    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2bk4\" (UniqueName: \"kubernetes.io/projected/de9ae8fd-00e6-48cd-8802-753647bad014-kube-api-access-j2bk4\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.306686 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:03:16.306595    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-serving-cert: secret "maas-api-e2e-inf-b-abb526-serving-cert" not found
Oct 30 22:03:16.306686 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.306652    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9ae8fd-00e6-48cd-8802-753647bad014-openshift-service-ca\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.306686 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:03:16.306675    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls podName:de9ae8fd-00e6-48cd-8802-753647bad014 nodeName:}" failed. No retries permitted until 2026-10-30 22:03:16.806654089 +0000 UTC m=+2397.838502616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls") pod "maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk" (UID: "de9ae8fd-00e6-48cd-8802-753647bad014") : secret "maas-api-e2e-inf-b-abb526-serving-cert" not found
Oct 30 22:03:16.306846 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.306750    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-metrics-certs\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.307313 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.307292    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9ae8fd-00e6-48cd-8802-753647bad014-openshift-service-ca\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.309371 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.309348    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-metrics-certs\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.371012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.370932    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2bk4\" (UniqueName: \"kubernetes.io/projected/de9ae8fd-00e6-48cd-8802-753647bad014-kube-api-access-j2bk4\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.462152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.462119    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:16.618756 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.618675    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:16.814886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.814854    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.817538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.817511    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls\") pod \"maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:16.963698 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:16.963670    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:17.353544 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:03:17.353516    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9ae8fd_00e6_48cd_8802_753647bad014.slice/crio-6579c0ca16ee027d2a201449ff1dad9834c06b25ad354a096a55cf53bc913df0 WatchSource:0}: Error finding container 6579c0ca16ee027d2a201449ff1dad9834c06b25ad354a096a55cf53bc913df0: Status 404 returned error can't find the container with id 6579c0ca16ee027d2a201449ff1dad9834c06b25ad354a096a55cf53bc913df0
Oct 30 22:03:17.353866 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:17.353567    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"]
Oct 30 22:03:17.918823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:17.918782    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk" event={"ID":"de9ae8fd-00e6-48cd-8802-753647bad014","Type":"ContainerStarted","Data":"6579c0ca16ee027d2a201449ff1dad9834c06b25ad354a096a55cf53bc913df0"}
Oct 30 22:03:18.945695 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:18.945660    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk" event={"ID":"de9ae8fd-00e6-48cd-8802-753647bad014","Type":"ContainerStarted","Data":"f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7"}
Oct 30 22:03:18.946111 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:18.945899    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:19.068286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:19.068233    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk" podStartSLOduration=3.264588623 podStartE2EDuration="4.068219896s" totalImagesPullingTime="803.631273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:19.06619351 +0000 UTC m=+2400.098042046" watchObservedRunningTime="2026-10-30 22:03:19.068219896 +0000 UTC m=+2400.100068467"
Oct 30 22:03:19.621814 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:19.621788    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:03:19.632865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:19.632796    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:03:19.653304 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:19.653277    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:03:19.662217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:19.662191    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:03:19.710545 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:19.710508    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:19.901048 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:19.901013    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:21.737408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:21.737372    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:23.488280 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:03:23.488239    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:03:24.965407 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:24.965379    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:03:26.842204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:26.842167    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:32.031245 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:32.031203    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:33.445867 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:33.445828    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:33.603106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:33.603075    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:37.118906 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:37.118865    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:41.971209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:41.971170    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:43.118087 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:43.118044    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"]
Oct 30 22:03:43.118666 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:43.118339    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy" containerID="cri-o://5f80a305e03a9d6654bd639dd83dfe68d039fd48b72f8ed9b2a92994989b7b3c" gracePeriod=30
Oct 30 22:03:43.137014 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:43.136953    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"]
Oct 30 22:03:43.137201 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:43.137177    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy" containerID="cri-o://2471cf1dab30bb92859f5e8874581865b7a9ecf468bace4b7a91412db6c077a8" gracePeriod=30
Oct 30 22:03:43.140515 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:43.140482    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:43.159575 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:43.159551    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"]
Oct 30 22:03:43.159774 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:43.159743    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy" containerID="cri-o://25cda5cfa928bb20c581f269a21677e1233a24b2fcf02ae4f8cc334652328158" gracePeriod=30
Oct 30 22:03:46.875284 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:46.875248    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:03:46.875736 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:46.875308    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:03:46.985341 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:46.985279    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:47.400506 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:47.400469    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:03:47.400726 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:47.400527    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:03:47.463793 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:47.463759    5575 patch_prober.go:29] interesting pod/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:03:47.463951 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:47.463830    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:03:48.317011 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.316700    5575 generic.go:356] "Generic (PLEG): container finished" podID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerID="2471cf1dab30bb92859f5e8874581865b7a9ecf468bace4b7a91412db6c077a8" exitCode=0
Oct 30 22:03:48.317011 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.316875    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" event={"ID":"ddc604a8-e33e-4237-b434-95a33c21b8aa","Type":"ContainerDied","Data":"2471cf1dab30bb92859f5e8874581865b7a9ecf468bace4b7a91412db6c077a8"}
Oct 30 22:03:48.320197 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.319483    5575 generic.go:356] "Generic (PLEG): container finished" podID="6c46f9c7-cf68-4884-9094-f2232d131174" containerID="25cda5cfa928bb20c581f269a21677e1233a24b2fcf02ae4f8cc334652328158" exitCode=0
Oct 30 22:03:48.320197 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.319680    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" event={"ID":"6c46f9c7-cf68-4884-9094-f2232d131174","Type":"ContainerDied","Data":"25cda5cfa928bb20c581f269a21677e1233a24b2fcf02ae4f8cc334652328158"}
Oct 30 22:03:48.322395 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.322218    5575 generic.go:356] "Generic (PLEG): container finished" podID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerID="5f80a305e03a9d6654bd639dd83dfe68d039fd48b72f8ed9b2a92994989b7b3c" exitCode=0
Oct 30 22:03:48.322395 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.322329    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" event={"ID":"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c","Type":"ContainerDied","Data":"5f80a305e03a9d6654bd639dd83dfe68d039fd48b72f8ed9b2a92994989b7b3c"}
Oct 30 22:03:48.686838 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.686041    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:03:48.703643 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.703610    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-kube-api-access-kmhv4\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-kube-api-access-kmhv4\") pod \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") "
Oct 30 22:03:48.704796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.704277    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-socket" pod "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" (UID: "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.704992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.704955    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-socket\") pod \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") "
Oct 30 22:03:48.705163 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.705147    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-data\") pod \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") "
Oct 30 22:03:48.705796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.705557    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-certs\") pod \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") "
Oct 30 22:03:48.706041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.706022    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-envoy\") pod \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") "
Oct 30 22:03:48.706530 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.705492    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-data" pod "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" (UID: "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.706530 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.705757    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-certs" pod "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" (UID: "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.706916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.706896    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istiod-ca-cert\") pod \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") "
Oct 30 22:03:48.707573 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.707402    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istiod-ca-cert" pod "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" (UID: "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:03:48.707690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.707664    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-kube-api-access-kmhv4" pod "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" (UID: "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c"). InnerVolumeSpecName "kube-api-access-kmhv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:48.707850 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.707825    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-podinfo\") pod \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") "
Oct 30 22:03:48.707917 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.707873    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-token\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-token\") pod \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") "
Oct 30 22:03:48.708008 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.707920    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-credential-socket\") pod \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\" (UID: \"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c\") "
Oct 30 22:03:48.708710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.708641    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.708710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.708673    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmhv4\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-kube-api-access-kmhv4\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.708710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.708663    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-credential-socket" pod "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" (UID: "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.708710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.708688    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.708710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.708703    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.709020 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.708717    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.710710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.710678    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-envoy" pod "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" (UID: "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.711434 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.711415    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-podinfo" pod "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" (UID: "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:03:48.714916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.714883    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-token" pod "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" (UID: "cb4d11d5-e205-43e7-bd12-0c2323cb2b1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:48.752921 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.752890    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:03:48.772212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.772185    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:03:48.809295 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809230    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-token\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-token\") pod \"ddc604a8-e33e-4237-b434-95a33c21b8aa\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") "
Oct 30 22:03:48.809527 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809367    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-data\") pod \"6c46f9c7-cf68-4884-9094-f2232d131174\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") "
Oct 30 22:03:48.809527 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809415    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-kube-api-access-sgnr9\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-kube-api-access-sgnr9\") pod \"ddc604a8-e33e-4237-b434-95a33c21b8aa\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") "
Oct 30 22:03:48.809527 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809462    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-kube-api-access-hrzcx\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-kube-api-access-hrzcx\") pod \"6c46f9c7-cf68-4884-9094-f2232d131174\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") "
Oct 30 22:03:48.809527 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809508    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-podinfo\") pod \"ddc604a8-e33e-4237-b434-95a33c21b8aa\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") "
Oct 30 22:03:48.809778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809591    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6c46f9c7-cf68-4884-9094-f2232d131174-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c46f9c7-cf68-4884-9094-f2232d131174-istio-podinfo\") pod \"6c46f9c7-cf68-4884-9094-f2232d131174\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") "
Oct 30 22:03:48.809778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809659    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-envoy\") pod \"6c46f9c7-cf68-4884-9094-f2232d131174\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") "
Oct 30 22:03:48.809778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809677    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-data" pod "6c46f9c7-cf68-4884-9094-f2232d131174" (UID: "6c46f9c7-cf68-4884-9094-f2232d131174"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.809778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809702    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-certs\") pod \"6c46f9c7-cf68-4884-9094-f2232d131174\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") "
Oct 30 22:03:48.810065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809838    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-envoy\") pod \"ddc604a8-e33e-4237-b434-95a33c21b8aa\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") "
Oct 30 22:03:48.810065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809882    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-socket\") pod \"6c46f9c7-cf68-4884-9094-f2232d131174\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") "
Oct 30 22:03:48.810065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.809926    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-socket\") pod \"ddc604a8-e33e-4237-b434-95a33c21b8aa\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") "
Oct 30 22:03:48.810065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.810027    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-istio-token\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-istio-token\") pod \"6c46f9c7-cf68-4884-9094-f2232d131174\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") "
Oct 30 22:03:48.810281 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.810077    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c46f9c7-cf68-4884-9094-f2232d131174-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c46f9c7-cf68-4884-9094-f2232d131174-istiod-ca-cert\") pod \"6c46f9c7-cf68-4884-9094-f2232d131174\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") "
Oct 30 22:03:48.810281 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.810153    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ddc604a8-e33e-4237-b434-95a33c21b8aa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc604a8-e33e-4237-b434-95a33c21b8aa-istiod-ca-cert\") pod \"ddc604a8-e33e-4237-b434-95a33c21b8aa\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") "
Oct 30 22:03:48.810281 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.810182    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-certs\") pod \"ddc604a8-e33e-4237-b434-95a33c21b8aa\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") "
Oct 30 22:03:48.810281 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.810228    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-data\") pod \"ddc604a8-e33e-4237-b434-95a33c21b8aa\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") "
Oct 30 22:03:48.810281 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.810264    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-credential-socket\") pod \"6c46f9c7-cf68-4884-9094-f2232d131174\" (UID: \"6c46f9c7-cf68-4884-9094-f2232d131174\") "
Oct 30 22:03:48.811119 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.810292    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-credential-socket\") pod \"ddc604a8-e33e-4237-b434-95a33c21b8aa\" (UID: \"ddc604a8-e33e-4237-b434-95a33c21b8aa\") "
Oct 30 22:03:48.811119 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.811096    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.811271 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.811122    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.811271 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.811139    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.811271 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.811154    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.811271 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.811171    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.811525 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.811323    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-socket" pod "ddc604a8-e33e-4237-b434-95a33c21b8aa" (UID: "ddc604a8-e33e-4237-b434-95a33c21b8aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.811525 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.811410    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-credential-socket" pod "ddc604a8-e33e-4237-b434-95a33c21b8aa" (UID: "ddc604a8-e33e-4237-b434-95a33c21b8aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.811525 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.811423    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-certs" pod "6c46f9c7-cf68-4884-9094-f2232d131174" (UID: "6c46f9c7-cf68-4884-9094-f2232d131174"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.813318 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.811915    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-socket" pod "6c46f9c7-cf68-4884-9094-f2232d131174" (UID: "6c46f9c7-cf68-4884-9094-f2232d131174"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.813318 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.812131    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-certs" pod "ddc604a8-e33e-4237-b434-95a33c21b8aa" (UID: "ddc604a8-e33e-4237-b434-95a33c21b8aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.813318 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.812439    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c46f9c7-cf68-4884-9094-f2232d131174-istiod-ca-cert" pod "6c46f9c7-cf68-4884-9094-f2232d131174" (UID: "6c46f9c7-cf68-4884-9094-f2232d131174"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:03:48.813318 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.812783    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc604a8-e33e-4237-b434-95a33c21b8aa-istiod-ca-cert" pod "ddc604a8-e33e-4237-b434-95a33c21b8aa" (UID: "ddc604a8-e33e-4237-b434-95a33c21b8aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:03:48.813318 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.813059    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-data" pod "ddc604a8-e33e-4237-b434-95a33c21b8aa" (UID: "ddc604a8-e33e-4237-b434-95a33c21b8aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.813318 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.813290    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-credential-socket" pod "6c46f9c7-cf68-4884-9094-f2232d131174" (UID: "6c46f9c7-cf68-4884-9094-f2232d131174"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.814166 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.814138    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-istio-token" pod "6c46f9c7-cf68-4884-9094-f2232d131174" (UID: "6c46f9c7-cf68-4884-9094-f2232d131174"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:48.814432 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.814377    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c46f9c7-cf68-4884-9094-f2232d131174-istio-podinfo" pod "6c46f9c7-cf68-4884-9094-f2232d131174" (UID: "6c46f9c7-cf68-4884-9094-f2232d131174"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:03:48.816380 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.816352    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-envoy" pod "6c46f9c7-cf68-4884-9094-f2232d131174" (UID: "6c46f9c7-cf68-4884-9094-f2232d131174"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.816938 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.816906    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-token" pod "ddc604a8-e33e-4237-b434-95a33c21b8aa" (UID: "ddc604a8-e33e-4237-b434-95a33c21b8aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:48.818464 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.818434    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-kube-api-access-hrzcx" pod "6c46f9c7-cf68-4884-9094-f2232d131174" (UID: "6c46f9c7-cf68-4884-9094-f2232d131174"). InnerVolumeSpecName "kube-api-access-hrzcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:48.820584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.820512    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-envoy" pod "ddc604a8-e33e-4237-b434-95a33c21b8aa" (UID: "ddc604a8-e33e-4237-b434-95a33c21b8aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:48.820867 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.820834    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-podinfo" pod "ddc604a8-e33e-4237-b434-95a33c21b8aa" (UID: "ddc604a8-e33e-4237-b434-95a33c21b8aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:03:48.823427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.823394    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-kube-api-access-sgnr9" pod "ddc604a8-e33e-4237-b434-95a33c21b8aa" (UID: "ddc604a8-e33e-4237-b434-95a33c21b8aa"). InnerVolumeSpecName "kube-api-access-sgnr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:48.912552 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912515    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrzcx\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-kube-api-access-hrzcx\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912552 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912550    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912575    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c46f9c7-cf68-4884-9094-f2232d131174-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912584    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912593    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912607    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912617    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912626    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912634    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c46f9c7-cf68-4884-9094-f2232d131174-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912643    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c46f9c7-cf68-4884-9094-f2232d131174-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912652    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc604a8-e33e-4237-b434-95a33c21b8aa-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912659    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912677    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912689    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c46f9c7-cf68-4884-9094-f2232d131174-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912698    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc604a8-e33e-4237-b434-95a33c21b8aa-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912705    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:48.912770 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:48.912713    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgnr9\" (UniqueName: \"kubernetes.io/projected/ddc604a8-e33e-4237-b434-95a33c21b8aa-kube-api-access-sgnr9\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:49.335993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.335930    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"
Oct 30 22:03:49.335993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.335951    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm" event={"ID":"6c46f9c7-cf68-4884-9094-f2232d131174","Type":"ContainerDied","Data":"3334a756f5728a4b84f2a885ea10dd5a411ba4a6422abfddcbdfad442bb39fbb"}
Oct 30 22:03:49.336548 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.336051    5575 scope.go:122] "RemoveContainer" containerID="25cda5cfa928bb20c581f269a21677e1233a24b2fcf02ae4f8cc334652328158"
Oct 30 22:03:49.338660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.338067    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"
Oct 30 22:03:49.338660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.338064    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc" event={"ID":"cb4d11d5-e205-43e7-bd12-0c2323cb2b1c","Type":"ContainerDied","Data":"7d04c6ca7240fcdf2204db6154316acaf2e03b3b872f2f515c8e4531512bbb32"}
Oct 30 22:03:49.340474 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.340454    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"
Oct 30 22:03:49.341826 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.340490    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7" event={"ID":"ddc604a8-e33e-4237-b434-95a33c21b8aa","Type":"ContainerDied","Data":"f68640a72f2af84efe3dd23a2690eea9de20c72e06bb26a96b7c5b5dbbda058a"}
Oct 30 22:03:49.350490 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.350464    5575 scope.go:122] "RemoveContainer" containerID="5f80a305e03a9d6654bd639dd83dfe68d039fd48b72f8ed9b2a92994989b7b3c"
Oct 30 22:03:49.361332 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.361315    5575 scope.go:122] "RemoveContainer" containerID="2471cf1dab30bb92859f5e8874581865b7a9ecf468bace4b7a91412db6c077a8"
Oct 30 22:03:49.524222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.524125    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"]
Oct 30 22:03:49.528171 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.528144    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-vmdx7"]
Oct 30 22:03:49.654898 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.654860    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"]
Oct 30 22:03:49.658892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.658865    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-ztdbm"]
Oct 30 22:03:49.771865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.771823    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"]
Oct 30 22:03:49.779871 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:49.779798    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-71a3d788-openshift-default-778558588f-r7gcc"]
Oct 30 22:03:50.200732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:50.200690    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:51.128772 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:51.128741    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" path="/var/lib/kubelet/pods/6c46f9c7-cf68-4884-9094-f2232d131174/volumes"
Oct 30 22:03:51.129278 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:51.129264    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" path="/var/lib/kubelet/pods/cb4d11d5-e205-43e7-bd12-0c2323cb2b1c/volumes"
Oct 30 22:03:51.129736 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:51.129722    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" path="/var/lib/kubelet/pods/ddc604a8-e33e-4237-b434-95a33c21b8aa/volumes"
Oct 30 22:03:52.635989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:52.634541    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:53.487371 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:03:53.487331    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:03:54.806983 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:54.806942    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:57.570253 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:03:57.570220    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:01.313505 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:01.313419    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:01.474336 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:01.474302    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:02.485702 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:02.485672    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:02.997914 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:02.997880    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:07.354445 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:07.354401    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:11.506059 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:11.506019    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"]
Oct 30 22:04:11.507641 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:11.506827    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4" podUID="032f367c-d938-4954-a392-bdefb78d4dd7" containerName="maas-api" containerID="cri-o://70684492125b4ed2f0623f9076f468a8840bcfed91cf78e6544667449c161e0a" gracePeriod=30
Oct 30 22:04:11.634105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:11.634071    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:12.896216 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:12.880265    5575 generic.go:356] "Generic (PLEG): container finished" podID="032f367c-d938-4954-a392-bdefb78d4dd7" containerID="70684492125b4ed2f0623f9076f468a8840bcfed91cf78e6544667449c161e0a" exitCode=0
Oct 30 22:04:12.896216 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:12.880389    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4" event={"ID":"032f367c-d938-4954-a392-bdefb78d4dd7","Type":"ContainerDied","Data":"70684492125b4ed2f0623f9076f468a8840bcfed91cf78e6544667449c161e0a"}
Oct 30 22:04:12.977182 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:12.977147    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 22:04:13.117041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.098720    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls\") pod \"032f367c-d938-4954-a392-bdefb78d4dd7\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") "
Oct 30 22:04:13.117041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.098811    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/032f367c-d938-4954-a392-bdefb78d4dd7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f367c-d938-4954-a392-bdefb78d4dd7-openshift-service-ca\") pod \"032f367c-d938-4954-a392-bdefb78d4dd7\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") "
Oct 30 22:04:13.117041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.098926    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/032f367c-d938-4954-a392-bdefb78d4dd7-kube-api-access-rzvdn\" (UniqueName: \"kubernetes.io/projected/032f367c-d938-4954-a392-bdefb78d4dd7-kube-api-access-rzvdn\") pod \"032f367c-d938-4954-a392-bdefb78d4dd7\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") "
Oct 30 22:04:13.117041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.099010    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-metrics-certs\") pod \"032f367c-d938-4954-a392-bdefb78d4dd7\" (UID: \"032f367c-d938-4954-a392-bdefb78d4dd7\") "
Oct 30 22:04:13.117041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.103821    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/032f367c-d938-4954-a392-bdefb78d4dd7-openshift-service-ca" pod "032f367c-d938-4954-a392-bdefb78d4dd7" (UID: "032f367c-d938-4954-a392-bdefb78d4dd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:04:13.307730 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.307692    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:13.432991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.432447    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls" pod "032f367c-d938-4954-a392-bdefb78d4dd7" (UID: "032f367c-d938-4954-a392-bdefb78d4dd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:04:13.432991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.432757    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/032f367c-d938-4954-a392-bdefb78d4dd7-kube-api-access-rzvdn" pod "032f367c-d938-4954-a392-bdefb78d4dd7" (UID: "032f367c-d938-4954-a392-bdefb78d4dd7"). InnerVolumeSpecName "kube-api-access-rzvdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:13.470007 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.468911    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-metrics-certs" pod "032f367c-d938-4954-a392-bdefb78d4dd7" (UID: "032f367c-d938-4954-a392-bdefb78d4dd7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:04:13.523358 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.523315    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:13.745902 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.529492    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 22:04:13.762988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.603953    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:13.762988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.748627    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f367c-d938-4954-a392-bdefb78d4dd7-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:13.762988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.748650    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzvdn\" (UniqueName: \"kubernetes.io/projected/032f367c-d938-4954-a392-bdefb78d4dd7-kube-api-access-rzvdn\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:13.762988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.748677    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/032f367c-d938-4954-a392-bdefb78d4dd7-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:13.878339 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:13.878205    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:14.122049 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:14.093281    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:14.163292 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:14.163259    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4" event={"ID":"032f367c-d938-4954-a392-bdefb78d4dd7","Type":"ContainerDied","Data":"5e8d51b8cbc7f6791b940f706ab51c5e59c6b14bb5ecd20d2b77d934f239f908"}
Oct 30 22:04:14.163552 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:14.163537    5575 scope.go:122] "RemoveContainer" containerID="70684492125b4ed2f0623f9076f468a8840bcfed91cf78e6544667449c161e0a"
Oct 30 22:04:14.163807 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:14.163792    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"
Oct 30 22:04:14.252997 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:14.249724    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:14.364441 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:04:14.364382    5575 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032f367c_d938_4954_a392_bdefb78d4dd7.slice/crio-5e8d51b8cbc7f6791b940f706ab51c5e59c6b14bb5ecd20d2b77d934f239f908\": RecentStats: unable to find data in memory cache]"
Oct 30 22:04:14.367799 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:04:14.367756    5575 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032f367c_d938_4954_a392_bdefb78d4dd7.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 22:04:14.380892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:14.370944    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"]
Oct 30 22:04:14.418145 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:14.418112    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-91874e-7b8cc8747f-hjbl4"]
Oct 30 22:04:15.128808 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:15.128774    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="032f367c-d938-4954-a392-bdefb78d4dd7" path="/var/lib/kubelet/pods/032f367c-d938-4954-a392-bdefb78d4dd7/volumes"
Oct 30 22:04:18.561999 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.561178    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"]
Oct 30 22:04:18.562536 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562394    5575 cpu_manager.go:414] "containerMap: removing container" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy"
Oct 30 22:04:18.562536 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562416    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy"
Oct 30 22:04:18.562536 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562433    5575 cpu_manager.go:414] "containerMap: removing container" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy"
Oct 30 22:04:18.562536 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562441    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy"
Oct 30 22:04:18.562536 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562467    5575 cpu_manager.go:414] "containerMap: removing container" podUID="032f367c-d938-4954-a392-bdefb78d4dd7" containerName="maas-api"
Oct 30 22:04:18.562536 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562475    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="032f367c-d938-4954-a392-bdefb78d4dd7" containerName="maas-api"
Oct 30 22:04:18.562536 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562538    5575 cpu_manager.go:414] "containerMap: removing container" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy"
Oct 30 22:04:18.562899 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562546    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy"
Oct 30 22:04:18.562899 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562747    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="032f367c-d938-4954-a392-bdefb78d4dd7" containerName="maas-api"
Oct 30 22:04:18.562899 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562776    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="ddc604a8-e33e-4237-b434-95a33c21b8aa" containerName="istio-proxy"
Oct 30 22:04:18.562899 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562789    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c46f9c7-cf68-4884-9094-f2232d131174" containerName="istio-proxy"
Oct 30 22:04:18.562899 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.562800    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb4d11d5-e205-43e7-bd12-0c2323cb2b1c" containerName="istio-proxy"
Oct 30 22:04:18.570538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.570511    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.627987 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.624664    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swz5p\" (UniqueName: \"kubernetes.io/projected/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-kube-api-access-swz5p\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.627987 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.624802    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.627987 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.624889    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-metrics-certs\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.627987 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.624985    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.633985 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.630059    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"]
Oct 30 22:04:18.678448 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.678419    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-19bc92-serving-cert\""
Oct 30 22:04:18.749989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.727074    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-metrics-certs\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.749989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.727188    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.749989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.727321    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swz5p\" (UniqueName: \"kubernetes.io/projected/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-kube-api-access-swz5p\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.749989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.727419    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.749989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.728219    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.750927 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:04:18.750901    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-serving-cert: secret "maas-api-e2e-inf-b-19bc92-serving-cert" not found
Oct 30 22:04:18.751173 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:04:18.751157    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls podName:9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0 nodeName:}" failed. No retries permitted until 2026-10-30 22:04:19.251133099 +0000 UTC m=+2460.282981629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls") pod "maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r" (UID: "9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0") : secret "maas-api-e2e-inf-b-19bc92-serving-cert" not found
Oct 30 22:04:18.777990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.772536    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-metrics-certs\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:18.837047 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.825430    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:18.869990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:18.846786    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swz5p\" (UniqueName: \"kubernetes.io/projected/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-kube-api-access-swz5p\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:19.041359 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:19.030818    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:19.240543 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:19.240513    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:19.266016 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:19.265986    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:19.268545 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:19.268524    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls\") pod \"maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:19.497778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:19.497679    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:19.885653 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:19.885624    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"]
Oct 30 22:04:19.886665 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:04:19.886638    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff8faf9_9e88_4e2f_9189_9ceadfa9a2b0.slice/crio-33a1013906e60107083a401eb7a7b7da96345c387512032ff1a531f0b2f47605 WatchSource:0}: Error finding container 33a1013906e60107083a401eb7a7b7da96345c387512032ff1a531f0b2f47605: Status 404 returned error can't find the container with id 33a1013906e60107083a401eb7a7b7da96345c387512032ff1a531f0b2f47605
Oct 30 22:04:20.221669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:20.221634    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r" event={"ID":"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0","Type":"ContainerStarted","Data":"33a1013906e60107083a401eb7a7b7da96345c387512032ff1a531f0b2f47605"}
Oct 30 22:04:20.852722 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:20.852692    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:21.009882 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:21.009793    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:21.188725 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:21.188675    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:21.234465 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:21.234430    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r" event={"ID":"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0","Type":"ContainerStarted","Data":"46e458089f09cfc38b90c8d7ce83a317c6118b34c286fea4182238d15f13e7e8"}
Oct 30 22:04:21.234657 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:21.234522    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:21.370042 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:21.363721    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r" podStartSLOduration=2.496389579 podStartE2EDuration="3.363702373s" totalImagesPullingTime="867.312794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:21.361409833 +0000 UTC m=+2462.393258368" watchObservedRunningTime="2026-10-30 22:04:21.363702373 +0000 UTC m=+2462.395550908"
Oct 30 22:04:23.487523 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:04:23.487482    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:04:24.061504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:24.061471    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:27.249398 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:27.249368    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:04:28.406471 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:28.406433    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:28.559522 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:28.559488    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:28.899954 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:28.899923    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:33.715672 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:33.715634    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:38.432026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:38.431992    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:38.598294 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:38.598248    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:38.769345 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:38.769262    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:43.601253 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:43.601215    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:48.195727 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.195692    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"]
Oct 30 22:04:48.200081 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.200063    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.254339 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.254299    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5a19c1-serving-cert\""
Oct 30 22:04:48.308767 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.308735    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"]
Oct 30 22:04:48.321020 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.320992    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-metrics-certs\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.321170 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.321074    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f62908-0b2f-4d38-841e-239162d48954-openshift-service-ca\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.321263 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.321232    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtkmf\" (UniqueName: \"kubernetes.io/projected/24f62908-0b2f-4d38-841e-239162d48954-kube-api-access-mtkmf\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.321309 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.321296    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.406515 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.406435    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:48.423339 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.423306    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-metrics-certs\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.423515 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.423435    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f62908-0b2f-4d38-841e-239162d48954-openshift-service-ca\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.423589 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.423534    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtkmf\" (UniqueName: \"kubernetes.io/projected/24f62908-0b2f-4d38-841e-239162d48954-kube-api-access-mtkmf\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.423589 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.423580    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.423844 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:04:48.423819    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-serving-cert: secret "maas-api-e2e-api-b-5a19c1-serving-cert" not found
Oct 30 22:04:48.423939 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:04:48.423898    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls podName:24f62908-0b2f-4d38-841e-239162d48954 nodeName:}" failed. No retries permitted until 2026-10-30 22:04:48.923876112 +0000 UTC m=+2489.955724626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls") pod "maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g" (UID: "24f62908-0b2f-4d38-841e-239162d48954") : secret "maas-api-e2e-api-b-5a19c1-serving-cert" not found
Oct 30 22:04:48.424181 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.424122    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f62908-0b2f-4d38-841e-239162d48954-openshift-service-ca\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.426043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.426015    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-metrics-certs\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.491055 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.489803    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtkmf\" (UniqueName: \"kubernetes.io/projected/24f62908-0b2f-4d38-841e-239162d48954-kube-api-access-mtkmf\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.616044 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.615944    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:48.770568 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.770470    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:48.932852 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.932804    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:48.935632 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:48.935601    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls\") pod \"maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:49.114856 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:49.114781    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:49.504123 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:49.504089    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"]
Oct 30 22:04:49.504578 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:04:49.504557    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f62908_0b2f_4d38_841e_239162d48954.slice/crio-f038c833268f9811f948b916259bb78bcfd75431a9acd6bb93af17083085bd1c WatchSource:0}: Error finding container f038c833268f9811f948b916259bb78bcfd75431a9acd6bb93af17083085bd1c: Status 404 returned error can't find the container with id f038c833268f9811f948b916259bb78bcfd75431a9acd6bb93af17083085bd1c
Oct 30 22:04:50.523222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:50.523028    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g" event={"ID":"24f62908-0b2f-4d38-841e-239162d48954","Type":"ContainerStarted","Data":"2e6fbd8e0b3c4e9d751b4bbd5f577f8f358906e024a8177aebaf98867ec9662f"}
Oct 30 22:04:50.523222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:50.523115    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g" event={"ID":"24f62908-0b2f-4d38-841e-239162d48954","Type":"ContainerStarted","Data":"f038c833268f9811f948b916259bb78bcfd75431a9acd6bb93af17083085bd1c"}
Oct 30 22:04:50.524034 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:50.524015    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:50.644996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:50.644930    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g" podStartSLOduration=1.8445175360000001 podStartE2EDuration="2.644915741s" totalImagesPullingTime="800.398205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:50.641450361 +0000 UTC m=+2491.673298896" watchObservedRunningTime="2026-10-30 22:04:50.644915741 +0000 UTC m=+2491.676764325"
Oct 30 22:04:53.424035 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:53.423993    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:53.513502 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:04:53.513454    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:04:55.160848 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:55.160802    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:55.323645 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:55.323612    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:57.546061 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:57.546034    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:04:58.454168 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:04:58.454133    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:02.743391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:02.743348    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:03.865586 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:03.865550    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:04.049867 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:04.049823    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:07.690853 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:07.690820    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"]
Oct 30 22:05:07.884896 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:07.884858    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:09.073829 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:09.073790    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:10.109931 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:10.109895    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:10.286551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:10.284384    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:14.426379 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:14.426339    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:15.309844 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:15.309806    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:15.473988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:15.471657    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:19.720024 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:19.719958    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:22.712809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:22.712747    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main" containerID="cri-o://456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969" gracePeriod=45
Oct 30 22:05:23.015479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.015450    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 22:05:23.104890 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.103456    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tls-certs\" (UniqueName: \"kubernetes.io/secret/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tls-certs\") pod \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") "
Oct 30 22:05:23.104890 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.103575    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-home\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-home\") pod \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") "
Oct 30 22:05:23.104890 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.103659    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-model-cache\") pod \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") "
Oct 30 22:05:23.104890 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.103787    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-dshm\") pod \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") "
Oct 30 22:05:23.104890 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.103869    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79a164f9-2c90-4e69-9e69-33ae76c94a5c-kube-api-access-gzmv6\" (UniqueName: \"kubernetes.io/projected/79a164f9-2c90-4e69-9e69-33ae76c94a5c-kube-api-access-gzmv6\") pod \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") "
Oct 30 22:05:23.104890 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.103906    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tmp-dir\") pod \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\" (UID: \"79a164f9-2c90-4e69-9e69-33ae76c94a5c\") "
Oct 30 22:05:23.105789 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.105453    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tmp-dir" pod "79a164f9-2c90-4e69-9e69-33ae76c94a5c" (UID: "79a164f9-2c90-4e69-9e69-33ae76c94a5c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:23.115447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.115415    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-model-cache" pod "79a164f9-2c90-4e69-9e69-33ae76c94a5c" (UID: "79a164f9-2c90-4e69-9e69-33ae76c94a5c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:23.115991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.115949    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-home" pod "79a164f9-2c90-4e69-9e69-33ae76c94a5c" (UID: "79a164f9-2c90-4e69-9e69-33ae76c94a5c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:23.187053 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.185266    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-dshm" pod "79a164f9-2c90-4e69-9e69-33ae76c94a5c" (UID: "79a164f9-2c90-4e69-9e69-33ae76c94a5c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:23.187053 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.187012    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tls-certs" pod "79a164f9-2c90-4e69-9e69-33ae76c94a5c" (UID: "79a164f9-2c90-4e69-9e69-33ae76c94a5c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:05:23.189184 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.189142    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a164f9-2c90-4e69-9e69-33ae76c94a5c-kube-api-access-gzmv6" pod "79a164f9-2c90-4e69-9e69-33ae76c94a5c" (UID: "79a164f9-2c90-4e69-9e69-33ae76c94a5c"). InnerVolumeSpecName "kube-api-access-gzmv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:23.206728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.206690    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzmv6\" (UniqueName: \"kubernetes.io/projected/79a164f9-2c90-4e69-9e69-33ae76c94a5c-kube-api-access-gzmv6\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.206877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.206757    5575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tmp-dir\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.206877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.206775    5575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a164f9-2c90-4e69-9e69-33ae76c94a5c-tls-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.206877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.206787    5575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-home\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.206877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.206800    5575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-model-cache\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.206877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.206812    5575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79a164f9-2c90-4e69-9e69-33ae76c94a5c-dshm\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.490165 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:05:23.490131    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:05:23.829282 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.829209    5575 generic.go:356] "Generic (PLEG): container finished" podID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerID="456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969" exitCode=0
Oct 30 22:05:23.829282 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.829263    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"
Oct 30 22:05:23.829734 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.829293    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" event={"ID":"79a164f9-2c90-4e69-9e69-33ae76c94a5c","Type":"ContainerDied","Data":"456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969"}
Oct 30 22:05:23.829734 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.829336    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm" event={"ID":"79a164f9-2c90-4e69-9e69-33ae76c94a5c","Type":"ContainerDied","Data":"b82ea8a3a9a8532d56916474c659d3275f944d7b4104e4af6e62c478a55b89c2"}
Oct 30 22:05:23.829734 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.829359    5575 scope.go:122] "RemoveContainer" containerID="456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969"
Oct 30 22:05:23.844402 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.844372    5575 scope.go:122] "RemoveContainer" containerID="456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969"
Oct 30 22:05:23.844775 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:05:23.844747    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969\": container with ID starting with 456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969 not found: ID does not exist" containerID="456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969"
Oct 30 22:05:23.844874 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.844787    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969"} err="failed to get container status \"456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969\": rpc error: code = NotFound desc = could not find container \"456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969\": container with ID starting with 456ba605e69d54dfaad831cb49f5b7c9c0e7666e692ca238072bb46d2e21c969 not found: ID does not exist"
Oct 30 22:05:23.996399 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:23.996364    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"]
Oct 30 22:05:24.048202 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:24.048158    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-d68156/distinct-2-w3-d68156-kserve-68d4484bb7-gssdm"]
Oct 30 22:05:25.048007 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:25.047759    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:25.177857 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:25.177820    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" path="/var/lib/kubelet/pods/79a164f9-2c90-4e69-9e69-33ae76c94a5c/volumes"
Oct 30 22:05:25.840993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:25.835021    5575 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:25.894302 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:25.894254    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:25.919595 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:25.919542    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:26.464714 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:26.464643    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:26.842267 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:26.842172    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 22:05:29.966384 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:29.966294    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:34.320024 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.319983    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"]
Oct 30 22:05:34.320908 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.320871    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x" podUID="4a31690a-328d-4349-8387-26e9dced072c" containerName="maas-api" containerID="cri-o://1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13" gracePeriod=30
Oct 30 22:05:34.431245 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.431206    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:34.696355 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.696322    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:05:34.772098 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.772060    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4a31690a-328d-4349-8387-26e9dced072c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a31690a-328d-4349-8387-26e9dced072c-openshift-service-ca\") pod \"4a31690a-328d-4349-8387-26e9dced072c\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") "
Oct 30 22:05:34.772308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.772125    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a31690a-328d-4349-8387-26e9dced072c-kube-api-access-b8mvt\" (UniqueName: \"kubernetes.io/projected/4a31690a-328d-4349-8387-26e9dced072c-kube-api-access-b8mvt\") pod \"4a31690a-328d-4349-8387-26e9dced072c\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") "
Oct 30 22:05:34.772308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.772272    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-metrics-certs\") pod \"4a31690a-328d-4349-8387-26e9dced072c\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") "
Oct 30 22:05:34.772500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.772482    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-maas-api-tls\") pod \"4a31690a-328d-4349-8387-26e9dced072c\" (UID: \"4a31690a-328d-4349-8387-26e9dced072c\") "
Oct 30 22:05:34.774372 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.774322    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a31690a-328d-4349-8387-26e9dced072c-openshift-service-ca" pod "4a31690a-328d-4349-8387-26e9dced072c" (UID: "4a31690a-328d-4349-8387-26e9dced072c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:05:34.783870 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.783805    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a31690a-328d-4349-8387-26e9dced072c-kube-api-access-b8mvt" pod "4a31690a-328d-4349-8387-26e9dced072c" (UID: "4a31690a-328d-4349-8387-26e9dced072c"). InnerVolumeSpecName "kube-api-access-b8mvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:34.784842 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.784810    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-maas-api-tls" pod "4a31690a-328d-4349-8387-26e9dced072c" (UID: "4a31690a-328d-4349-8387-26e9dced072c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:05:34.789782 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.789742    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-metrics-certs" pod "4a31690a-328d-4349-8387-26e9dced072c" (UID: "4a31690a-328d-4349-8387-26e9dced072c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:05:34.874635 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.874587    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:34.874841 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.874823    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a31690a-328d-4349-8387-26e9dced072c-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:34.874919 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.874906    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a31690a-328d-4349-8387-26e9dced072c-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:34.875004 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:34.874994    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8mvt\" (UniqueName: \"kubernetes.io/projected/4a31690a-328d-4349-8387-26e9dced072c-kube-api-access-b8mvt\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:35.206363 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.206274    5575 generic.go:356] "Generic (PLEG): container finished" podID="4a31690a-328d-4349-8387-26e9dced072c" containerID="1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13" exitCode=0
Oct 30 22:05:35.206363 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.206323    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x" event={"ID":"4a31690a-328d-4349-8387-26e9dced072c","Type":"ContainerDied","Data":"1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13"}
Oct 30 22:05:35.206363 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.206348    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"
Oct 30 22:05:35.207099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.206945    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x" event={"ID":"4a31690a-328d-4349-8387-26e9dced072c","Type":"ContainerDied","Data":"4b2d111a0f4720b5f0d496b6a31bb9a8e8a0ce68d5690dbd2434f2e6afc0ad4c"}
Oct 30 22:05:35.207099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.206996    5575 scope.go:122] "RemoveContainer" containerID="1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13"
Oct 30 22:05:35.208446 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.208427    5575 generic.go:356] "Generic (PLEG): container finished" podID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerID="618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b" exitCode=0
Oct 30 22:05:35.208598 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.208572    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" event={"ID":"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf","Type":"ContainerDied","Data":"618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b"}
Oct 30 22:05:35.209312 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.209291    5575 scope.go:122] "RemoveContainer" containerID="618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b"
Oct 30 22:05:35.211462 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.211429    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:05:35.211567 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.211515    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:05:35.211626 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.211564    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:05:35.221268 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.221247    5575 scope.go:122] "RemoveContainer" containerID="1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13"
Oct 30 22:05:35.221551 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:05:35.221524    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13\": container with ID starting with 1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13 not found: ID does not exist" containerID="1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13"
Oct 30 22:05:35.221623 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.221562    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13"} err="failed to get container status \"1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13\": rpc error: code = NotFound desc = could not find container \"1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13\": container with ID starting with 1713fbd0344eb4a0a61fe3a47db9757ff4a7703b31e0a843c717686982b58d13 not found: ID does not exist"
Oct 30 22:05:35.516007 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.514750    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"]
Oct 30 22:05:35.523016 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.521851    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8c5350-864b5f7876-85d8x"]
Oct 30 22:05:35.983280 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:35.983243    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:36.203681 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:36.203644    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:36.225089 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:36.225056    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" event={"ID":"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf","Type":"ContainerStarted","Data":"90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743"}
Oct 30 22:05:36.372469 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:36.372372    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:36.667950 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:36.667908    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:05:36.668876 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:36.668851    5575 patch_prober.go:29] interesting pod/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:05:36.669040 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:36.668902    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:05:37.149580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:37.149534    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a31690a-328d-4349-8387-26e9dced072c" path="/var/lib/kubelet/pods/4a31690a-328d-4349-8387-26e9dced072c/volumes"
Oct 30 22:05:37.668256 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:37.668224    5575 patch_prober.go:29] interesting pod/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:05:37.668679 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:37.668285    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:05:38.667248 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:38.667215    5575 patch_prober.go:29] interesting pod/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:05:38.667467 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:38.667275    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:05:39.668164 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:39.668122    5575 patch_prober.go:29] interesting pod/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:05:39.668796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:39.668178    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:05:40.667904 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:40.667867    5575 patch_prober.go:29] interesting pod/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:05:40.668117 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:40.667931    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:05:40.831141 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:40.831094    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:05:41.530994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:41.529768    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:41.667926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:41.667888    5575 patch_prober.go:29] interesting pod/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:05:41.668144 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:41.667955    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:05:42.672573 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:42.672540    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:05:42.673620 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:42.673602    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:05:45.520999 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:45.518316    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:45.683561 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:45.683477    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:45.955886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:45.955823    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:46.962052 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:46.961993    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:47.119273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:47.119221    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:51.814592 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:51.814557    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:51.977032 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:51.976960    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:52.195927 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:52.195885    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:53.226388 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:53.226354    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:53.487105 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:05:53.487015    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:05:53.509364 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:53.509330    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:53.603259 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:53.603227    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"]
Oct 30 22:05:53.603444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:53.603423    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy" containerID="cri-o://725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e" gracePeriod=30
Oct 30 22:05:53.757047 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:53.754392    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:54.261184 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:54.261141    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:55.513749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:55.513701    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:57.449444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:57.449407    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:58.893434 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:58.893408    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 22:05:59.033538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.033499    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-data\") pod \"61c0d99c-0998-48b5-9367-ef699d3608c7\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") "
Oct 30 22:05:59.033749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.033547    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-podinfo\") pod \"61c0d99c-0998-48b5-9367-ef699d3608c7\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") "
Oct 30 22:05:59.033749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.033568    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-socket\") pod \"61c0d99c-0998-48b5-9367-ef699d3608c7\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") "
Oct 30 22:05:59.033749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.033624    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-envoy\") pod \"61c0d99c-0998-48b5-9367-ef699d3608c7\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") "
Oct 30 22:05:59.033749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.033697    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-kube-api-access-p2wwq\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-kube-api-access-p2wwq\") pod \"61c0d99c-0998-48b5-9367-ef699d3608c7\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") "
Oct 30 22:05:59.033989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.033760    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61c0d99c-0998-48b5-9367-ef699d3608c7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c0d99c-0998-48b5-9367-ef699d3608c7-istiod-ca-cert\") pod \"61c0d99c-0998-48b5-9367-ef699d3608c7\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") "
Oct 30 22:05:59.033989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.033834    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-credential-socket\") pod \"61c0d99c-0998-48b5-9367-ef699d3608c7\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") "
Oct 30 22:05:59.033989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.033875    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-data" pod "61c0d99c-0998-48b5-9367-ef699d3608c7" (UID: "61c0d99c-0998-48b5-9367-ef699d3608c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:59.034151 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.033983    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-socket" pod "61c0d99c-0998-48b5-9367-ef699d3608c7" (UID: "61c0d99c-0998-48b5-9367-ef699d3608c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:59.034151 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.034017    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-token\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-token\") pod \"61c0d99c-0998-48b5-9367-ef699d3608c7\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") "
Oct 30 22:05:59.034151 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.034096    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-certs\") pod \"61c0d99c-0998-48b5-9367-ef699d3608c7\" (UID: \"61c0d99c-0998-48b5-9367-ef699d3608c7\") "
Oct 30 22:05:59.034304 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.034180    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-credential-socket" pod "61c0d99c-0998-48b5-9367-ef699d3608c7" (UID: "61c0d99c-0998-48b5-9367-ef699d3608c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:59.034502 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.034433    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-certs" pod "61c0d99c-0998-48b5-9367-ef699d3608c7" (UID: "61c0d99c-0998-48b5-9367-ef699d3608c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:59.034799 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.034756    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61c0d99c-0998-48b5-9367-ef699d3608c7-istiod-ca-cert" pod "61c0d99c-0998-48b5-9367-ef699d3608c7" (UID: "61c0d99c-0998-48b5-9367-ef699d3608c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:05:59.034944 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.034816    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:59.035084 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.035067    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:59.035206 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.035169    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:59.035206 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.035187    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:59.036826 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.036779    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-kube-api-access-p2wwq" pod "61c0d99c-0998-48b5-9367-ef699d3608c7" (UID: "61c0d99c-0998-48b5-9367-ef699d3608c7"). InnerVolumeSpecName "kube-api-access-p2wwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:59.036923 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.036894    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-token" pod "61c0d99c-0998-48b5-9367-ef699d3608c7" (UID: "61c0d99c-0998-48b5-9367-ef699d3608c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:59.037154 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.037132    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-envoy" pod "61c0d99c-0998-48b5-9367-ef699d3608c7" (UID: "61c0d99c-0998-48b5-9367-ef699d3608c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:59.037275 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.037259    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-podinfo" pod "61c0d99c-0998-48b5-9367-ef699d3608c7" (UID: "61c0d99c-0998-48b5-9367-ef699d3608c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:05:59.136041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.136011    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2wwq\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-kube-api-access-p2wwq\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:59.136041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.136038    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c0d99c-0998-48b5-9367-ef699d3608c7-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:59.136041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.136048    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:59.136278 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.136057    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:59.136278 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.136067    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c0d99c-0998-48b5-9367-ef699d3608c7-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:59.443057 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.442926    5575 generic.go:356] "Generic (PLEG): container finished" podID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerID="725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e" exitCode=0
Oct 30 22:05:59.443057 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.443008    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" event={"ID":"61c0d99c-0998-48b5-9367-ef699d3608c7","Type":"ContainerDied","Data":"725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e"}
Oct 30 22:05:59.443261 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.443060    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq" event={"ID":"61c0d99c-0998-48b5-9367-ef699d3608c7","Type":"ContainerDied","Data":"c255feddc2c04ec610aa65357c3a1509ddcd6790e9b4f79c1eb8d39716ef8841"}
Oct 30 22:05:59.443261 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.443091    5575 scope.go:122] "RemoveContainer" containerID="725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e"
Oct 30 22:05:59.443261 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.443251    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"
Oct 30 22:05:59.459465 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.459445    5575 scope.go:122] "RemoveContainer" containerID="0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf"
Oct 30 22:05:59.470060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.470034    5575 scope.go:122] "RemoveContainer" containerID="725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e"
Oct 30 22:05:59.470390 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:05:59.470371    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e\": container with ID starting with 725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e not found: ID does not exist" containerID="725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e"
Oct 30 22:05:59.470460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.470398    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e"} err="failed to get container status \"725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e\": rpc error: code = NotFound desc = could not find container \"725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e\": container with ID starting with 725d5920a96be01f427272749f2d6b0357a0c7eb1f6bc30ec489b0cfd758c45e not found: ID does not exist"
Oct 30 22:05:59.470460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.470417    5575 scope.go:122] "RemoveContainer" containerID="0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf"
Oct 30 22:05:59.470644 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:05:59.470624    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf\": container with ID starting with 0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf not found: ID does not exist" containerID="0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf"
Oct 30 22:05:59.470683 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.470652    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf"} err="failed to get container status \"0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf\": rpc error: code = NotFound desc = could not find container \"0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf\": container with ID starting with 0402301b38bb8cce297d1cd3eafa9a8315f2b4ea48d4e8c4515168cd9cace0cf not found: ID does not exist"
Oct 30 22:05:59.612148 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.612115    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"]
Oct 30 22:05:59.615938 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:05:59.615907    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8c5350-openshift-default-85cfc865d7-xtprq"]
Oct 30 22:06:01.128703 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:01.128673    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" path="/var/lib/kubelet/pods/61c0d99c-0998-48b5-9367-ef699d3608c7/volumes"
Oct 30 22:06:02.340864 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:02.340816    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:06.021176 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:06.021142    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"]
Oct 30 22:06:06.132742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:06.132705    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"]
Oct 30 22:06:06.406759 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:06.406699    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:06.573875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:06.573840    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:07.259134 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:07.259104    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:11.022378 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.022316    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w" podUID="04a714f1-f0e9-4139-8535-49cff452f67f" containerName="payload-processing" containerID="cri-o://7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1" gracePeriod=25
Oct 30 22:06:11.133162 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.133087    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf" podUID="91caf8c6-8a1e-4125-881f-2c95b5832283" containerName="payload-pre-processing" containerID="cri-o://d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff" gracePeriod=25
Oct 30 22:06:11.329953 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.329918    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:06:11.418604 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.418560    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04a714f1-f0e9-4139-8535-49cff452f67f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a714f1-f0e9-4139-8535-49cff452f67f-plugins-config-volume\") pod \"04a714f1-f0e9-4139-8535-49cff452f67f\" (UID: \"04a714f1-f0e9-4139-8535-49cff452f67f\") "
Oct 30 22:06:11.418791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.418623    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04a714f1-f0e9-4139-8535-49cff452f67f-kube-api-access-rvtsv\" (UniqueName: \"kubernetes.io/projected/04a714f1-f0e9-4139-8535-49cff452f67f-kube-api-access-rvtsv\") pod \"04a714f1-f0e9-4139-8535-49cff452f67f\" (UID: \"04a714f1-f0e9-4139-8535-49cff452f67f\") "
Oct 30 22:06:11.419071 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.419045    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a714f1-f0e9-4139-8535-49cff452f67f-plugins-config-volume" pod "04a714f1-f0e9-4139-8535-49cff452f67f" (UID: "04a714f1-f0e9-4139-8535-49cff452f67f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:06:11.419296 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.419278    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a714f1-f0e9-4139-8535-49cff452f67f-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:11.479865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.470279    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a714f1-f0e9-4139-8535-49cff452f67f-kube-api-access-rvtsv" pod "04a714f1-f0e9-4139-8535-49cff452f67f" (UID: "04a714f1-f0e9-4139-8535-49cff452f67f"). InnerVolumeSpecName "kube-api-access-rvtsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:06:11.525255 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.525191    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvtsv\" (UniqueName: \"kubernetes.io/projected/04a714f1-f0e9-4139-8535-49cff452f67f-kube-api-access-rvtsv\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:11.544035 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.534363    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:06:11.611555 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.611515    5575 generic.go:356] "Generic (PLEG): container finished" podID="91caf8c6-8a1e-4125-881f-2c95b5832283" containerID="d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff" exitCode=0
Oct 30 22:06:11.611868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.611564    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"
Oct 30 22:06:11.611868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.611609    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf" event={"ID":"91caf8c6-8a1e-4125-881f-2c95b5832283","Type":"ContainerDied","Data":"d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff"}
Oct 30 22:06:11.611868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.611654    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf" event={"ID":"91caf8c6-8a1e-4125-881f-2c95b5832283","Type":"ContainerDied","Data":"036410d5bca331e2e443a7db42be8846bfdd230a8a31fd06e1d06a766cd1cebd"}
Oct 30 22:06:11.611868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.611681    5575 scope.go:122] "RemoveContainer" containerID="d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff"
Oct 30 22:06:11.615249 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.615226    5575 generic.go:356] "Generic (PLEG): container finished" podID="04a714f1-f0e9-4139-8535-49cff452f67f" containerID="7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1" exitCode=0
Oct 30 22:06:11.615447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.615254    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"
Oct 30 22:06:11.615604 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.615268    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w" event={"ID":"04a714f1-f0e9-4139-8535-49cff452f67f","Type":"ContainerDied","Data":"7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1"}
Oct 30 22:06:11.615692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.615642    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w" event={"ID":"04a714f1-f0e9-4139-8535-49cff452f67f","Type":"ContainerDied","Data":"4a97a8e8c9e7d1c4bc4bef4842bc8e02e3417c66e063b41a8c6a9a2030d90509"}
Oct 30 22:06:11.626335 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.626309    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/91caf8c6-8a1e-4125-881f-2c95b5832283-kube-api-access-fx22c\" (UniqueName: \"kubernetes.io/projected/91caf8c6-8a1e-4125-881f-2c95b5832283-kube-api-access-fx22c\") pod \"91caf8c6-8a1e-4125-881f-2c95b5832283\" (UID: \"91caf8c6-8a1e-4125-881f-2c95b5832283\") "
Oct 30 22:06:11.626795 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.626775    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/91caf8c6-8a1e-4125-881f-2c95b5832283-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91caf8c6-8a1e-4125-881f-2c95b5832283-plugins-config-volume\") pod \"91caf8c6-8a1e-4125-881f-2c95b5832283\" (UID: \"91caf8c6-8a1e-4125-881f-2c95b5832283\") "
Oct 30 22:06:11.627652 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.627281    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91caf8c6-8a1e-4125-881f-2c95b5832283-plugins-config-volume" pod "91caf8c6-8a1e-4125-881f-2c95b5832283" (UID: "91caf8c6-8a1e-4125-881f-2c95b5832283"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:06:11.628394 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.628374    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91caf8c6-8a1e-4125-881f-2c95b5832283-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:11.629644 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.629619    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91caf8c6-8a1e-4125-881f-2c95b5832283-kube-api-access-fx22c" pod "91caf8c6-8a1e-4125-881f-2c95b5832283" (UID: "91caf8c6-8a1e-4125-881f-2c95b5832283"). InnerVolumeSpecName "kube-api-access-fx22c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:06:11.631667 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.631526    5575 scope.go:122] "RemoveContainer" containerID="d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff"
Oct 30 22:06:11.632106 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:06:11.632080    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff\": container with ID starting with d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff not found: ID does not exist" containerID="d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff"
Oct 30 22:06:11.632200 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.632122    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff"} err="failed to get container status \"d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff\": rpc error: code = NotFound desc = could not find container \"d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff\": container with ID starting with d9c6721389b5911d3f7476d8608e23bba1bd24f3f21a0ade8da007438ccf68ff not found: ID does not exist"
Oct 30 22:06:11.632200 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.632140    5575 scope.go:122] "RemoveContainer" containerID="7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1"
Oct 30 22:06:11.644756 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.644736    5575 scope.go:122] "RemoveContainer" containerID="7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1"
Oct 30 22:06:11.645068 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:06:11.645036    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1\": container with ID starting with 7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1 not found: ID does not exist" containerID="7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1"
Oct 30 22:06:11.645151 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.645074    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1"} err="failed to get container status \"7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1\": rpc error: code = NotFound desc = could not find container \"7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1\": container with ID starting with 7918fdd99c53c0884df972eb808de7dbe1c60a733d9acb05f9c25a81a8539fc1 not found: ID does not exist"
Oct 30 22:06:11.730018 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.729985    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx22c\" (UniqueName: \"kubernetes.io/projected/91caf8c6-8a1e-4125-881f-2c95b5832283-kube-api-access-fx22c\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:11.775780 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.775740    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"]
Oct 30 22:06:11.780768 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:11.780732    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-abb526-854c8c8d7d-xsw7w"]
Oct 30 22:06:12.040319 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:12.040290    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"]
Oct 30 22:06:12.046460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:12.046433    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-abb526-74b477cf5-qt8xf"]
Oct 30 22:06:12.203159 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:12.203077    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:13.129306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:13.129272    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04a714f1-f0e9-4139-8535-49cff452f67f" path="/var/lib/kubelet/pods/04a714f1-f0e9-4139-8535-49cff452f67f/volumes"
Oct 30 22:06:13.129808 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:13.129694    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="91caf8c6-8a1e-4125-881f-2c95b5832283" path="/var/lib/kubelet/pods/91caf8c6-8a1e-4125-881f-2c95b5832283/volumes"
Oct 30 22:06:17.461285 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:17.461247    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:21.909991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:21.908295    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"]
Oct 30 22:06:21.909991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:21.908546    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk" podUID="de9ae8fd-00e6-48cd-8802-753647bad014" containerName="maas-api" containerID="cri-o://f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7" gracePeriod=30
Oct 30 22:06:22.004816 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.004738    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:22.338001 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.337634    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:06:22.514173 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.514079    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de9ae8fd-00e6-48cd-8802-753647bad014-kube-api-access-j2bk4\" (UniqueName: \"kubernetes.io/projected/de9ae8fd-00e6-48cd-8802-753647bad014-kube-api-access-j2bk4\") pod \"de9ae8fd-00e6-48cd-8802-753647bad014\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") "
Oct 30 22:06:22.514173 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.514130    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls\") pod \"de9ae8fd-00e6-48cd-8802-753647bad014\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") "
Oct 30 22:06:22.514467 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.514220    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/de9ae8fd-00e6-48cd-8802-753647bad014-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9ae8fd-00e6-48cd-8802-753647bad014-openshift-service-ca\") pod \"de9ae8fd-00e6-48cd-8802-753647bad014\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") "
Oct 30 22:06:22.514467 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.514260    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-metrics-certs\") pod \"de9ae8fd-00e6-48cd-8802-753647bad014\" (UID: \"de9ae8fd-00e6-48cd-8802-753647bad014\") "
Oct 30 22:06:22.514700 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.514650    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de9ae8fd-00e6-48cd-8802-753647bad014-openshift-service-ca" pod "de9ae8fd-00e6-48cd-8802-753647bad014" (UID: "de9ae8fd-00e6-48cd-8802-753647bad014"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:06:22.515003 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.514953    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9ae8fd-00e6-48cd-8802-753647bad014-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:22.516826 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.516793    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de9ae8fd-00e6-48cd-8802-753647bad014-kube-api-access-j2bk4" pod "de9ae8fd-00e6-48cd-8802-753647bad014" (UID: "de9ae8fd-00e6-48cd-8802-753647bad014"). InnerVolumeSpecName "kube-api-access-j2bk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:06:22.517424 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.517399    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-metrics-certs" pod "de9ae8fd-00e6-48cd-8802-753647bad014" (UID: "de9ae8fd-00e6-48cd-8802-753647bad014"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:06:22.518204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.518153    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls" pod "de9ae8fd-00e6-48cd-8802-753647bad014" (UID: "de9ae8fd-00e6-48cd-8802-753647bad014"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:06:22.616566 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.616535    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2bk4\" (UniqueName: \"kubernetes.io/projected/de9ae8fd-00e6-48cd-8802-753647bad014-kube-api-access-j2bk4\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:22.616566 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.616565    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:22.616566 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.616574    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9ae8fd-00e6-48cd-8802-753647bad014-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:22.709862 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.709825    5575 generic.go:356] "Generic (PLEG): container finished" podID="de9ae8fd-00e6-48cd-8802-753647bad014" containerID="f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7" exitCode=0
Oct 30 22:06:22.710067 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.709877    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"
Oct 30 22:06:22.710067 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.709905    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk" event={"ID":"de9ae8fd-00e6-48cd-8802-753647bad014","Type":"ContainerDied","Data":"f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7"}
Oct 30 22:06:22.710067 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.709957    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk" event={"ID":"de9ae8fd-00e6-48cd-8802-753647bad014","Type":"ContainerDied","Data":"6579c0ca16ee027d2a201449ff1dad9834c06b25ad354a096a55cf53bc913df0"}
Oct 30 22:06:22.710067 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.709987    5575 scope.go:122] "RemoveContainer" containerID="f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7"
Oct 30 22:06:22.721865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.721835    5575 scope.go:122] "RemoveContainer" containerID="f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7"
Oct 30 22:06:22.722149 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:06:22.722129    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7\": container with ID starting with f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7 not found: ID does not exist" containerID="f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7"
Oct 30 22:06:22.722226 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.722162    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7"} err="failed to get container status \"f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7\": rpc error: code = NotFound desc = could not find container \"f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7\": container with ID starting with f7b903ab209b172dd58067e35cc92bcd654a0bee917c03a7ae6bdf4a662387f7 not found: ID does not exist"
Oct 30 22:06:22.904993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.894830    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"]
Oct 30 22:06:22.908988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:22.907293    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-abb526-697c8d45d9-hsgjk"]
Oct 30 22:06:23.127697 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:23.127657    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de9ae8fd-00e6-48cd-8802-753647bad014" path="/var/lib/kubelet/pods/de9ae8fd-00e6-48cd-8802-753647bad014/volumes"
Oct 30 22:06:23.488352 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:06:23.488305    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:06:23.663721 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:23.663694    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:23.868577 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:23.868469    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:24.045733 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:24.045691    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:24.764820 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:24.764785    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:24.944126 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:24.944045    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:29.064031 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:29.063958    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:29.275284 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:29.275254    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"]
Oct 30 22:06:29.653591 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:29.653557    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:29.828408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:29.828354    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:33.235704 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:33.235668    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:34.166767 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.166718    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:34.276424 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.276383    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5" podUID="67b836e9-6dee-44b6-a6c9-3beffd1ac3d9" containerName="payload-processing" containerID="cri-o://8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6" gracePeriod=25
Oct 30 22:06:34.575197 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.575166    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:06:34.618534 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.618502    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-kube-api-access-grnf5\" (UniqueName: \"kubernetes.io/projected/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-kube-api-access-grnf5\") pod \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\" (UID: \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\") "
Oct 30 22:06:34.618717 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.618579    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-plugins-config-volume\") pod \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\" (UID: \"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9\") "
Oct 30 22:06:34.618992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.618939    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-plugins-config-volume" pod "67b836e9-6dee-44b6-a6c9-3beffd1ac3d9" (UID: "67b836e9-6dee-44b6-a6c9-3beffd1ac3d9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:06:34.619196 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.619179    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:34.620951 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.620930    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-kube-api-access-grnf5" pod "67b836e9-6dee-44b6-a6c9-3beffd1ac3d9" (UID: "67b836e9-6dee-44b6-a6c9-3beffd1ac3d9"). InnerVolumeSpecName "kube-api-access-grnf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:06:34.720805 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.720708    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grnf5\" (UniqueName: \"kubernetes.io/projected/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9-kube-api-access-grnf5\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:34.720981 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.720858    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:34.854010 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.853961    5575 generic.go:356] "Generic (PLEG): container finished" podID="67b836e9-6dee-44b6-a6c9-3beffd1ac3d9" containerID="8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6" exitCode=0
Oct 30 22:06:34.854196 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.854049    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"
Oct 30 22:06:34.854196 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.854062    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5" event={"ID":"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9","Type":"ContainerDied","Data":"8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6"}
Oct 30 22:06:34.854196 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.854153    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5" event={"ID":"67b836e9-6dee-44b6-a6c9-3beffd1ac3d9","Type":"ContainerDied","Data":"ea4f4c43fba19e4318a6fba4416d50e4ba4ff54946f7d4267dffa3413a2b1222"}
Oct 30 22:06:34.854196 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.854183    5575 scope.go:122] "RemoveContainer" containerID="8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6"
Oct 30 22:06:34.865495 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.865474    5575 scope.go:122] "RemoveContainer" containerID="8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6"
Oct 30 22:06:34.865804 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:06:34.865767    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6\": container with ID starting with 8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6 not found: ID does not exist" containerID="8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6"
Oct 30 22:06:34.865921 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:34.865816    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6"} err="failed to get container status \"8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6\": rpc error: code = NotFound desc = could not find container \"8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6\": container with ID starting with 8c500959808be0ac9feed01bfd279343c5e3605606c1f96152ff840718ff1eb6 not found: ID does not exist"
Oct 30 22:06:35.024142 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:35.024039    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"]
Oct 30 22:06:35.027955 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:35.027927    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ae1bd5-5cffdddb9d-dp6n5"]
Oct 30 22:06:35.129202 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:35.129168    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67b836e9-6dee-44b6-a6c9-3beffd1ac3d9" path="/var/lib/kubelet/pods/67b836e9-6dee-44b6-a6c9-3beffd1ac3d9/volumes"
Oct 30 22:06:39.001382 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:39.001330    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:40.793241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:40.793207    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:40.958198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:40.958160    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:41.188217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:41.188186    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:43.992035 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:43.991994    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:49.340950 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:49.340913    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:51.847834 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:51.847790    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:53.487353 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:06:53.487310    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:06:54.011648 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:54.011616    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"]
Oct 30 22:06:54.126253 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:54.126214    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"]
Oct 30 22:06:54.384308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:54.384274    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:54.542297 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:54.542253    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:54.706075 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:54.705933    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:55.870271 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:55.870233    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:58.467825 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.467788    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"]
Oct 30 22:06:58.468456 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468441    5575 cpu_manager.go:414] "containerMap: removing container" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy"
Oct 30 22:06:58.468456 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468457    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468475    5575 cpu_manager.go:414] "containerMap: removing container" podUID="4a31690a-328d-4349-8387-26e9dced072c" containerName="maas-api"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468480    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a31690a-328d-4349-8387-26e9dced072c" containerName="maas-api"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468496    5575 cpu_manager.go:414] "containerMap: removing container" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468501    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468513    5575 cpu_manager.go:414] "containerMap: removing container" podUID="04a714f1-f0e9-4139-8535-49cff452f67f" containerName="payload-processing"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468519    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04a714f1-f0e9-4139-8535-49cff452f67f" containerName="payload-processing"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468538    5575 cpu_manager.go:414] "containerMap: removing container" podUID="67b836e9-6dee-44b6-a6c9-3beffd1ac3d9" containerName="payload-processing"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468543    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67b836e9-6dee-44b6-a6c9-3beffd1ac3d9" containerName="payload-processing"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468549    5575 cpu_manager.go:414] "containerMap: removing container" podUID="de9ae8fd-00e6-48cd-8802-753647bad014" containerName="maas-api"
Oct 30 22:06:58.468557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468554    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de9ae8fd-00e6-48cd-8802-753647bad014" containerName="maas-api"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468572    5575 cpu_manager.go:414] "containerMap: removing container" podUID="91caf8c6-8a1e-4125-881f-2c95b5832283" containerName="payload-pre-processing"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468578    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91caf8c6-8a1e-4125-881f-2c95b5832283" containerName="payload-pre-processing"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468689    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a31690a-328d-4349-8387-26e9dced072c" containerName="maas-api"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468700    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="79a164f9-2c90-4e69-9e69-33ae76c94a5c" containerName="main"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468706    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="04a714f1-f0e9-4139-8535-49cff452f67f" containerName="payload-processing"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468715    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="67b836e9-6dee-44b6-a6c9-3beffd1ac3d9" containerName="payload-processing"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468720    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="de9ae8fd-00e6-48cd-8802-753647bad014" containerName="maas-api"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468728    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="91caf8c6-8a1e-4125-881f-2c95b5832283" containerName="payload-pre-processing"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468732    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy"
Oct 30 22:06:58.468875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.468738    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy"
Oct 30 22:06:58.472315 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.472298    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.532238 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.532196    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"]
Oct 30 22:06:58.549192 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.549162    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-19bc92\"/\"kube-root-ca.crt\""
Oct 30 22:06:58.553598 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.553569    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-tmp-dir\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.553842 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.553629    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-home\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.553842 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.553777    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlqgh\" (UniqueName: \"kubernetes.io/projected/ce6344e4-4221-4a54-b13b-015a90c1f861-kube-api-access-rlqgh\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.554079 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.554060    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6344e4-4221-4a54-b13b-015a90c1f861-tls-certs\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.554140 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.554112    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-dshm\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.554180 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.554157    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-model-cache\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.554502 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.554479    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:58.576404 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.576373    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-19bc92\"/\"openshift-service-ca.crt\""
Oct 30 22:06:58.576583 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.576406    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-19bc92\"/\"test-model-19bc92-kserve-self-signed-certs\""
Oct 30 22:06:58.576583 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.576522    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-19bc92\"/\"default-dockercfg-2bhrk\""
Oct 30 22:06:58.655543 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.655507    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-dshm\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.655543 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.655555    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-model-cache\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.655828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.655605    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-tmp-dir\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.655828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.655644    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-home\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.655828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.655691    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlqgh\" (UniqueName: \"kubernetes.io/projected/ce6344e4-4221-4a54-b13b-015a90c1f861-kube-api-access-rlqgh\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.656017 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.655985    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6344e4-4221-4a54-b13b-015a90c1f861-tls-certs\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.656085 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.656072    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-model-cache\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.656238 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.656218    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-home\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.656411 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.656396    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-tmp-dir\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.662322 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.662293    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-dshm\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.662659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.662610    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6344e4-4221-4a54-b13b-015a90c1f861-tls-certs\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.718229 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.718152    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlqgh\" (UniqueName: \"kubernetes.io/projected/ce6344e4-4221-4a54-b13b-015a90c1f861-kube-api-access-rlqgh\") pod \"test-model-19bc92-kserve-7f874f449f-zdnqv\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") " pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:58.787295 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:58.787260    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:06:59.012700 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.012595    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4" podUID="870682b8-47fa-4b93-8c6a-3aebef115d87" containerName="payload-processing" containerID="cri-o://181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09" gracePeriod=25
Oct 30 22:06:59.133120 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.130727    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx" podUID="529fb24b-6b8f-426a-adff-749192f21652" containerName="payload-pre-processing" containerID="cri-o://6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e" gracePeriod=25
Oct 30 22:06:59.149121 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.149091    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:59.180465 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.180438    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"]
Oct 30 22:06:59.186332 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:06:59.186298    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce6344e4_4221_4a54_b13b_015a90c1f861.slice/crio-2b903920745181534eec298d529c33a7ab8795464bc682f337cf8b08bc5cc8c0 WatchSource:0}: Error finding container 2b903920745181534eec298d529c33a7ab8795464bc682f337cf8b08bc5cc8c0: Status 404 returned error can't find the container with id 2b903920745181534eec298d529c33a7ab8795464bc682f337cf8b08bc5cc8c0
Oct 30 22:06:59.357777 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.357656    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 22:06:59.387319 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.387292    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/870682b8-47fa-4b93-8c6a-3aebef115d87-kube-api-access-rjkbk\" (UniqueName: \"kubernetes.io/projected/870682b8-47fa-4b93-8c6a-3aebef115d87-kube-api-access-rjkbk\") pod \"870682b8-47fa-4b93-8c6a-3aebef115d87\" (UID: \"870682b8-47fa-4b93-8c6a-3aebef115d87\") "
Oct 30 22:06:59.387724 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.387331    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/870682b8-47fa-4b93-8c6a-3aebef115d87-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870682b8-47fa-4b93-8c6a-3aebef115d87-plugins-config-volume\") pod \"870682b8-47fa-4b93-8c6a-3aebef115d87\" (UID: \"870682b8-47fa-4b93-8c6a-3aebef115d87\") "
Oct 30 22:06:59.388299 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.388056    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/870682b8-47fa-4b93-8c6a-3aebef115d87-plugins-config-volume" pod "870682b8-47fa-4b93-8c6a-3aebef115d87" (UID: "870682b8-47fa-4b93-8c6a-3aebef115d87"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:06:59.391637 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.391592    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/870682b8-47fa-4b93-8c6a-3aebef115d87-kube-api-access-rjkbk" pod "870682b8-47fa-4b93-8c6a-3aebef115d87" (UID: "870682b8-47fa-4b93-8c6a-3aebef115d87"). InnerVolumeSpecName "kube-api-access-rjkbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:06:59.493075 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.492491    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjkbk\" (UniqueName: \"kubernetes.io/projected/870682b8-47fa-4b93-8c6a-3aebef115d87-kube-api-access-rjkbk\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:59.493075 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.492533    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870682b8-47fa-4b93-8c6a-3aebef115d87-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:59.576414 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.576350    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 22:06:59.694782 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.694752    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/529fb24b-6b8f-426a-adff-749192f21652-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fb24b-6b8f-426a-adff-749192f21652-plugins-config-volume\") pod \"529fb24b-6b8f-426a-adff-749192f21652\" (UID: \"529fb24b-6b8f-426a-adff-749192f21652\") "
Oct 30 22:06:59.695029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.694871    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/529fb24b-6b8f-426a-adff-749192f21652-kube-api-access-zpts7\" (UniqueName: \"kubernetes.io/projected/529fb24b-6b8f-426a-adff-749192f21652-kube-api-access-zpts7\") pod \"529fb24b-6b8f-426a-adff-749192f21652\" (UID: \"529fb24b-6b8f-426a-adff-749192f21652\") "
Oct 30 22:06:59.696178 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.695265    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/529fb24b-6b8f-426a-adff-749192f21652-plugins-config-volume" pod "529fb24b-6b8f-426a-adff-749192f21652" (UID: "529fb24b-6b8f-426a-adff-749192f21652"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:06:59.696178 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.696086    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fb24b-6b8f-426a-adff-749192f21652-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:06:59.698229 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.698197    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/529fb24b-6b8f-426a-adff-749192f21652-kube-api-access-zpts7" pod "529fb24b-6b8f-426a-adff-749192f21652" (UID: "529fb24b-6b8f-426a-adff-749192f21652"). InnerVolumeSpecName "kube-api-access-zpts7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:06:59.797855 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:06:59.797813    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpts7\" (UniqueName: \"kubernetes.io/projected/529fb24b-6b8f-426a-adff-749192f21652-kube-api-access-zpts7\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:00.109146 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.109107    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv" event={"ID":"ce6344e4-4221-4a54-b13b-015a90c1f861","Type":"ContainerStarted","Data":"715f4e32d7a4b73d34686a14ad05db7c235968da342608dd02b43d92c2ef7037"}
Oct 30 22:07:00.109417 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.109398    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv" event={"ID":"ce6344e4-4221-4a54-b13b-015a90c1f861","Type":"ContainerStarted","Data":"2b903920745181534eec298d529c33a7ab8795464bc682f337cf8b08bc5cc8c0"}
Oct 30 22:07:00.130900 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.130866    5575 generic.go:356] "Generic (PLEG): container finished" podID="529fb24b-6b8f-426a-adff-749192f21652" containerID="6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e" exitCode=0
Oct 30 22:07:00.131604 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.131305    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"
Oct 30 22:07:00.148035 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.131328    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx" event={"ID":"529fb24b-6b8f-426a-adff-749192f21652","Type":"ContainerDied","Data":"6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e"}
Oct 30 22:07:00.148331 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.148305    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx" event={"ID":"529fb24b-6b8f-426a-adff-749192f21652","Type":"ContainerDied","Data":"98e9b6273074ab6d51e9ea53042d63fdabf55d547a2edbc5b5b68a5312c14e67"}
Oct 30 22:07:00.148448 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.148435    5575 scope.go:122] "RemoveContainer" containerID="6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e"
Oct 30 22:07:00.162495 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.162461    5575 generic.go:356] "Generic (PLEG): container finished" podID="870682b8-47fa-4b93-8c6a-3aebef115d87" containerID="181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09" exitCode=0
Oct 30 22:07:00.165074 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.162800    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"
Oct 30 22:07:00.165463 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.162834    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4" event={"ID":"870682b8-47fa-4b93-8c6a-3aebef115d87","Type":"ContainerDied","Data":"181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09"}
Oct 30 22:07:00.165660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.165623    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4" event={"ID":"870682b8-47fa-4b93-8c6a-3aebef115d87","Type":"ContainerDied","Data":"3848270795d75c85c560d40d55f4eddc1b1b2f92b31316b3be33023f78d9e44e"}
Oct 30 22:07:00.187569 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.187544    5575 scope.go:122] "RemoveContainer" containerID="6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e"
Oct 30 22:07:00.188343 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:07:00.188306    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e\": container with ID starting with 6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e not found: ID does not exist" containerID="6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e"
Oct 30 22:07:00.188460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.188356    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e"} err="failed to get container status \"6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e\": rpc error: code = NotFound desc = could not find container \"6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e\": container with ID starting with 6bb257ed668ddbf090eb5d819c6e625a62bf65c5ec5184b96819e656d038197e not found: ID does not exist"
Oct 30 22:07:00.188460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.188382    5575 scope.go:122] "RemoveContainer" containerID="181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09"
Oct 30 22:07:00.199663 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.199641    5575 scope.go:122] "RemoveContainer" containerID="181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09"
Oct 30 22:07:00.200019 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:07:00.199952    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09\": container with ID starting with 181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09 not found: ID does not exist" containerID="181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09"
Oct 30 22:07:00.200094 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.200029    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09"} err="failed to get container status \"181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09\": rpc error: code = NotFound desc = could not find container \"181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09\": container with ID starting with 181e6574a04e211b90e0badb8efe7b703d0fdf162ad12482fef26a412a894a09 not found: ID does not exist"
Oct 30 22:07:00.248275 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.248217    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv" podStartSLOduration=2.248198904 podStartE2EDuration="2.248198904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:00.244218966 +0000 UTC m=+2621.276067514" watchObservedRunningTime="2026-10-30 22:07:00.248198904 +0000 UTC m=+2621.280047441"
Oct 30 22:07:00.366531 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.362144    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"]
Oct 30 22:07:00.369110 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.369077    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2c8f56-7bdf687fd7-q9gwx"]
Oct 30 22:07:00.476425 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.476385    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"]
Oct 30 22:07:00.482434 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.482401    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-2c8f56-74f5d9cd7b-47ff4"]
Oct 30 22:07:00.785776 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.785746    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:00.787616 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:00.787599    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:07:01.065368 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:01.065289    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:01.141135 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:01.141087    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="529fb24b-6b8f-426a-adff-749192f21652" path="/var/lib/kubelet/pods/529fb24b-6b8f-426a-adff-749192f21652/volumes"
Oct 30 22:07:01.141914 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:01.141887    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="870682b8-47fa-4b93-8c6a-3aebef115d87" path="/var/lib/kubelet/pods/870682b8-47fa-4b93-8c6a-3aebef115d87/volumes"
Oct 30 22:07:01.276376 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:01.276331    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:01.731290 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:01.731256    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:06.371342 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:06.371311    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:07.777353 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:07.777318    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:07.934033 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:07.933996    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:08.144983 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:08.144936    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"]
Oct 30 22:07:08.145423 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:08.145393    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy" containerID="cri-o://ee0f97cf070e86441e721e0324f791bb2319d54362567d4c928aad2cf792508b" gracePeriod=30
Oct 30 22:07:08.166406 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:08.166371    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:08.787911 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:08.787875    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:07:08.801023 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:08.800993    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:07:09.350766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:09.350736    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:07:09.731378 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:09.731346    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:09.902871 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:09.902833    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:11.302561 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:11.302527    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:12.940114 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:12.940074    5575 patch_prober.go:29] interesting pod/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:07:12.940499 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:12.940129    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:07:13.404492 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.404453    5575 generic.go:356] "Generic (PLEG): container finished" podID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerID="ee0f97cf070e86441e721e0324f791bb2319d54362567d4c928aad2cf792508b" exitCode=0
Oct 30 22:07:13.404736 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.404716    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" event={"ID":"fb9f5642-220c-44e0-99be-5151a484e3d3","Type":"ContainerDied","Data":"ee0f97cf070e86441e721e0324f791bb2319d54362567d4c928aad2cf792508b"}
Oct 30 22:07:13.404845 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.404809    5575 scope.go:122] "RemoveContainer" containerID="b0792d67b115172dd68ae3769f5194c52af13bb02c8f8c6ffdac3f3e2b779e74"
Oct 30 22:07:13.467049 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.467024    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 22:07:13.550507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.550417    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-token\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-token\") pod \"fb9f5642-220c-44e0-99be-5151a484e3d3\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") "
Oct 30 22:07:13.550679 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.550568    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-kube-api-access-b82ht\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-kube-api-access-b82ht\") pod \"fb9f5642-220c-44e0-99be-5151a484e3d3\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") "
Oct 30 22:07:13.550679 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.550600    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-socket\") pod \"fb9f5642-220c-44e0-99be-5151a484e3d3\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") "
Oct 30 22:07:13.550794 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.550690    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-podinfo\") pod \"fb9f5642-220c-44e0-99be-5151a484e3d3\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") "
Oct 30 22:07:13.550794 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.550734    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-certs\") pod \"fb9f5642-220c-44e0-99be-5151a484e3d3\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") "
Oct 30 22:07:13.550918 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.550836    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-credential-socket\") pod \"fb9f5642-220c-44e0-99be-5151a484e3d3\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") "
Oct 30 22:07:13.551012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.550916    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-data\") pod \"fb9f5642-220c-44e0-99be-5151a484e3d3\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") "
Oct 30 22:07:13.551012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.550952    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb9f5642-220c-44e0-99be-5151a484e3d3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9f5642-220c-44e0-99be-5151a484e3d3-istiod-ca-cert\") pod \"fb9f5642-220c-44e0-99be-5151a484e3d3\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") "
Oct 30 22:07:13.551130 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.551015    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-envoy\") pod \"fb9f5642-220c-44e0-99be-5151a484e3d3\" (UID: \"fb9f5642-220c-44e0-99be-5151a484e3d3\") "
Oct 30 22:07:13.551188 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.551129    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-certs" pod "fb9f5642-220c-44e0-99be-5151a484e3d3" (UID: "fb9f5642-220c-44e0-99be-5151a484e3d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:13.551749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.551330    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-credential-socket" pod "fb9f5642-220c-44e0-99be-5151a484e3d3" (UID: "fb9f5642-220c-44e0-99be-5151a484e3d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:13.551749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.551491    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:13.551749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.551508    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:13.551749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.551551    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-data" pod "fb9f5642-220c-44e0-99be-5151a484e3d3" (UID: "fb9f5642-220c-44e0-99be-5151a484e3d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:13.551749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.551653    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-socket" pod "fb9f5642-220c-44e0-99be-5151a484e3d3" (UID: "fb9f5642-220c-44e0-99be-5151a484e3d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:13.551749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.551713    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb9f5642-220c-44e0-99be-5151a484e3d3-istiod-ca-cert" pod "fb9f5642-220c-44e0-99be-5151a484e3d3" (UID: "fb9f5642-220c-44e0-99be-5151a484e3d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:13.553236 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.553213    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-token" pod "fb9f5642-220c-44e0-99be-5151a484e3d3" (UID: "fb9f5642-220c-44e0-99be-5151a484e3d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:13.553435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.553411    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-kube-api-access-b82ht" pod "fb9f5642-220c-44e0-99be-5151a484e3d3" (UID: "fb9f5642-220c-44e0-99be-5151a484e3d3"). InnerVolumeSpecName "kube-api-access-b82ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:13.554098 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.554073    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-envoy" pod "fb9f5642-220c-44e0-99be-5151a484e3d3" (UID: "fb9f5642-220c-44e0-99be-5151a484e3d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:13.554211 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.554105    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-podinfo" pod "fb9f5642-220c-44e0-99be-5151a484e3d3" (UID: "fb9f5642-220c-44e0-99be-5151a484e3d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:07:13.653788 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.653736    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:13.654102 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.654080    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9f5642-220c-44e0-99be-5151a484e3d3-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:13.654241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.654220    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:13.654351 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.654245    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:13.654351 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.654261    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b82ht\" (UniqueName: \"kubernetes.io/projected/fb9f5642-220c-44e0-99be-5151a484e3d3-kube-api-access-b82ht\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:13.654351 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.654278    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9f5642-220c-44e0-99be-5151a484e3d3-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:13.654351 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:13.654291    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9f5642-220c-44e0-99be-5151a484e3d3-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:14.415275 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:14.415247    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"
Oct 30 22:07:14.415763 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:14.415288    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2" event={"ID":"fb9f5642-220c-44e0-99be-5151a484e3d3","Type":"ContainerDied","Data":"9839e4abe719b9dd320a566963ec730b5bcedf9441b8e5ddc0c71070951acdbb"}
Oct 30 22:07:14.415763 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:14.415359    5575 scope.go:122] "RemoveContainer" containerID="ee0f97cf070e86441e721e0324f791bb2319d54362567d4c928aad2cf792508b"
Oct 30 22:07:14.637613 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:14.637577    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"]
Oct 30 22:07:14.685411 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:14.685323    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-d68156-openshift-default-797fb546b7-tp9x2"]
Oct 30 22:07:15.128417 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:15.128343    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" path="/var/lib/kubelet/pods/fb9f5642-220c-44e0-99be-5151a484e3d3/volumes"
Oct 30 22:07:15.836885 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:15.836854    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:15.991695 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:15.991658    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:16.243095 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:16.243036    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:21.169138 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:21.169087    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:23.267420 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:23.267361    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:23.491321 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:07:23.491285    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:07:24.153819 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:24.153783    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:25.992942 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:25.992904    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:30.887550 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:30.887498    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:33.697984 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:33.697931    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:35.028059 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.028018    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"]
Oct 30 22:07:35.028579 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.028279    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7" podUID="17ca55b8-7545-4c28-b0c3-97618de3dd3f" containerName="maas-api" containerID="cri-o://b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e" gracePeriod=30
Oct 30 22:07:35.161492 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.161458    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:35.348783 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.348703    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 22:07:35.352076 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.352048    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17ca55b8-7545-4c28-b0c3-97618de3dd3f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17ca55b8-7545-4c28-b0c3-97618de3dd3f-openshift-service-ca\") pod \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") "
Oct 30 22:07:35.352337 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.352316    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-metrics-certs\") pod \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") "
Oct 30 22:07:35.352455 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.352361    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls\") pod \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") "
Oct 30 22:07:35.352455 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.352395    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17ca55b8-7545-4c28-b0c3-97618de3dd3f-openshift-service-ca" pod "17ca55b8-7545-4c28-b0c3-97618de3dd3f" (UID: "17ca55b8-7545-4c28-b0c3-97618de3dd3f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:35.352455 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.352407    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17ca55b8-7545-4c28-b0c3-97618de3dd3f-kube-api-access-g8h94\" (UniqueName: \"kubernetes.io/projected/17ca55b8-7545-4c28-b0c3-97618de3dd3f-kube-api-access-g8h94\") pod \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\" (UID: \"17ca55b8-7545-4c28-b0c3-97618de3dd3f\") "
Oct 30 22:07:35.353587 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.353415    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17ca55b8-7545-4c28-b0c3-97618de3dd3f-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:35.355210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.355183    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-metrics-certs" pod "17ca55b8-7545-4c28-b0c3-97618de3dd3f" (UID: "17ca55b8-7545-4c28-b0c3-97618de3dd3f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:07:35.355467 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.355440    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17ca55b8-7545-4c28-b0c3-97618de3dd3f-kube-api-access-g8h94" pod "17ca55b8-7545-4c28-b0c3-97618de3dd3f" (UID: "17ca55b8-7545-4c28-b0c3-97618de3dd3f"). InnerVolumeSpecName "kube-api-access-g8h94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:35.355554 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.355493    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls" pod "17ca55b8-7545-4c28-b0c3-97618de3dd3f" (UID: "17ca55b8-7545-4c28-b0c3-97618de3dd3f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:07:35.471676 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.464386    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:35.471676 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.464412    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17ca55b8-7545-4c28-b0c3-97618de3dd3f-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:35.471676 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.464423    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8h94\" (UniqueName: \"kubernetes.io/projected/17ca55b8-7545-4c28-b0c3-97618de3dd3f-kube-api-access-g8h94\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:35.621043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.615787    5575 generic.go:356] "Generic (PLEG): container finished" podID="17ca55b8-7545-4c28-b0c3-97618de3dd3f" containerID="b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e" exitCode=0
Oct 30 22:07:35.621043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.615894    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7" event={"ID":"17ca55b8-7545-4c28-b0c3-97618de3dd3f","Type":"ContainerDied","Data":"b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e"}
Oct 30 22:07:35.621043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.615946    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7" event={"ID":"17ca55b8-7545-4c28-b0c3-97618de3dd3f","Type":"ContainerDied","Data":"ae9b6ffb808c298ac9f8772bd8695b45560f451071e62b709abdd5259f44877a"}
Oct 30 22:07:35.621043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.615995    5575 scope.go:122] "RemoveContainer" containerID="b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e"
Oct 30 22:07:35.621043 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.616177    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"
Oct 30 22:07:35.633435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.633407    5575 scope.go:122] "RemoveContainer" containerID="b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e"
Oct 30 22:07:35.633759 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:07:35.633735    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e\": container with ID starting with b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e not found: ID does not exist" containerID="b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e"
Oct 30 22:07:35.633844 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.633772    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e"} err="failed to get container status \"b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e\": rpc error: code = NotFound desc = could not find container \"b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e\": container with ID starting with b2b1663b5e90bb0bf4551767f88e000e7ef9991dd1bbd0cb3c4e778b7248046e not found: ID does not exist"
Oct 30 22:07:35.788551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.788518    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"]
Oct 30 22:07:35.793593 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:35.793568    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-2c8f56-868c7444db-7pvh7"]
Oct 30 22:07:36.753374 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:36.753337    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:36.972002 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:36.971952    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:37.129958 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:37.129871    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17ca55b8-7545-4c28-b0c3-97618de3dd3f" path="/var/lib/kubelet/pods/17ca55b8-7545-4c28-b0c3-97618de3dd3f/volumes"
Oct 30 22:07:37.222682 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:37.222645    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:37.680777 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:37.680739    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:42.146242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:42.146203    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:44.062722 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:44.062691    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:44.240292 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:44.240263    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:44.385564 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:44.385530    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"]
Oct 30 22:07:44.385817 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:44.385789    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy" containerID="cri-o://c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e" gracePeriod=30
Oct 30 22:07:44.403292 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:44.403257    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:47.163378 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:47.163334    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:49.656330 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.656275    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 22:07:49.736833 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.736801    5575 generic.go:356] "Generic (PLEG): container finished" podID="5391e528-4cac-4c13-9148-e9eb152ed874" containerID="c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e" exitCode=0
Oct 30 22:07:49.737015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.736858    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"
Oct 30 22:07:49.737015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.736852    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" event={"ID":"5391e528-4cac-4c13-9148-e9eb152ed874","Type":"ContainerDied","Data":"c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e"}
Oct 30 22:07:49.737124 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.737019    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl" event={"ID":"5391e528-4cac-4c13-9148-e9eb152ed874","Type":"ContainerDied","Data":"355c181c96f91bb1b8bae42129d758b329046c49669b689e3648251e111a755f"}
Oct 30 22:07:49.737124 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.737050    5575 scope.go:122] "RemoveContainer" containerID="c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e"
Oct 30 22:07:49.748608 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.748587    5575 scope.go:122] "RemoveContainer" containerID="9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0"
Oct 30 22:07:49.758469 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.758451    5575 scope.go:122] "RemoveContainer" containerID="c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e"
Oct 30 22:07:49.758776 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:07:49.758756    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e\": container with ID starting with c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e not found: ID does not exist" containerID="c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e"
Oct 30 22:07:49.758851 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.758784    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e"} err="failed to get container status \"c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e\": rpc error: code = NotFound desc = could not find container \"c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e\": container with ID starting with c21896d0a84bee4a56777c3df13682a6b3f2f582fe0dc4b085a91aa20febb55e not found: ID does not exist"
Oct 30 22:07:49.758851 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.758802    5575 scope.go:122] "RemoveContainer" containerID="9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0"
Oct 30 22:07:49.759105 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:07:49.759077    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0\": container with ID starting with 9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0 not found: ID does not exist" containerID="9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0"
Oct 30 22:07:49.759163 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.759112    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0"} err="failed to get container status \"9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0\": rpc error: code = NotFound desc = could not find container \"9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0\": container with ID starting with 9240ef044142f589fa63f7a3831e28e75e491042735a380253f6d956736308f0 not found: ID does not exist"
Oct 30 22:07:49.801721 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.801695    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-data\") pod \"5391e528-4cac-4c13-9148-e9eb152ed874\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") "
Oct 30 22:07:49.801823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.801758    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5391e528-4cac-4c13-9148-e9eb152ed874-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5391e528-4cac-4c13-9148-e9eb152ed874-istiod-ca-cert\") pod \"5391e528-4cac-4c13-9148-e9eb152ed874\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") "
Oct 30 22:07:49.801823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.801795    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-kube-api-access-794dl\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-kube-api-access-794dl\") pod \"5391e528-4cac-4c13-9148-e9eb152ed874\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") "
Oct 30 22:07:49.801926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.801847    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-credential-socket\") pod \"5391e528-4cac-4c13-9148-e9eb152ed874\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") "
Oct 30 22:07:49.801926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.801863    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5391e528-4cac-4c13-9148-e9eb152ed874-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5391e528-4cac-4c13-9148-e9eb152ed874-istio-podinfo\") pod \"5391e528-4cac-4c13-9148-e9eb152ed874\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") "
Oct 30 22:07:49.801926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.801890    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-certs\") pod \"5391e528-4cac-4c13-9148-e9eb152ed874\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") "
Oct 30 22:07:49.801926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.801914    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-socket\") pod \"5391e528-4cac-4c13-9148-e9eb152ed874\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") "
Oct 30 22:07:49.802170 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.801917    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-data" pod "5391e528-4cac-4c13-9148-e9eb152ed874" (UID: "5391e528-4cac-4c13-9148-e9eb152ed874"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:49.802170 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.801948    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-istio-token\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-istio-token\") pod \"5391e528-4cac-4c13-9148-e9eb152ed874\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") "
Oct 30 22:07:49.802170 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802079    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-envoy\") pod \"5391e528-4cac-4c13-9148-e9eb152ed874\" (UID: \"5391e528-4cac-4c13-9148-e9eb152ed874\") "
Oct 30 22:07:49.802331 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802195    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-certs" pod "5391e528-4cac-4c13-9148-e9eb152ed874" (UID: "5391e528-4cac-4c13-9148-e9eb152ed874"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:49.802331 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802257    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-socket" pod "5391e528-4cac-4c13-9148-e9eb152ed874" (UID: "5391e528-4cac-4c13-9148-e9eb152ed874"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:49.802331 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802266    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5391e528-4cac-4c13-9148-e9eb152ed874-istiod-ca-cert" pod "5391e528-4cac-4c13-9148-e9eb152ed874" (UID: "5391e528-4cac-4c13-9148-e9eb152ed874"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:49.802505 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802367    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-credential-socket" pod "5391e528-4cac-4c13-9148-e9eb152ed874" (UID: "5391e528-4cac-4c13-9148-e9eb152ed874"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:49.802711 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802647    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:49.802711 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802668    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:49.802711 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802677    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:49.802711 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802688    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:49.802711 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.802701    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5391e528-4cac-4c13-9148-e9eb152ed874-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:49.804333 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.804309    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-kube-api-access-794dl" pod "5391e528-4cac-4c13-9148-e9eb152ed874" (UID: "5391e528-4cac-4c13-9148-e9eb152ed874"). InnerVolumeSpecName "kube-api-access-794dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:49.804425 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.804360    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-envoy" pod "5391e528-4cac-4c13-9148-e9eb152ed874" (UID: "5391e528-4cac-4c13-9148-e9eb152ed874"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:49.804682 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.804650    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-istio-token" pod "5391e528-4cac-4c13-9148-e9eb152ed874" (UID: "5391e528-4cac-4c13-9148-e9eb152ed874"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:49.804682 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.804652    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5391e528-4cac-4c13-9148-e9eb152ed874-istio-podinfo" pod "5391e528-4cac-4c13-9148-e9eb152ed874" (UID: "5391e528-4cac-4c13-9148-e9eb152ed874"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:07:49.903642 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.903614    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-794dl\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-kube-api-access-794dl\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:49.903642 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.903641    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5391e528-4cac-4c13-9148-e9eb152ed874-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:49.903854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.903651    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5391e528-4cac-4c13-9148-e9eb152ed874-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:49.903854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:49.903660    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5391e528-4cac-4c13-9148-e9eb152ed874-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:50.163981 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:50.163933    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"]
Oct 30 22:07:50.170538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:50.170507    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-2c8f56-openshift-default-5c48f9884c-gdzwl"]
Oct 30 22:07:51.128976 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:51.128927    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" path="/var/lib/kubelet/pods/5391e528-4cac-4c13-9148-e9eb152ed874/volumes"
Oct 30 22:07:52.394297 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:52.394256    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:53.486880 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:07:53.486841    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:07:56.215068 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:56.215015    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:56.394134 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:56.394091    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:57.241449 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:57.241413    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:57.402512 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:57.402470    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:57.575411 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:07:57.575302    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:02.468643 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:02.468603    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:07.339085 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:07.339047    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:12.296578 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:12.296531    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:17.227054 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:17.227014    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:19.699811 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:19.699780    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:08:19.708555 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:19.708534    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:08:19.716438 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:19.716413    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:08:19.724135 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:19.724113    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:08:22.124943 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:22.124888    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:23.487597 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:08:23.487557    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:08:26.266502 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.266463    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"]
Oct 30 22:08:26.266994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.266717    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5" podUID="6ce56670-6071-44a1-a588-9fa0f0a34598" containerName="maas-api" containerID="cri-o://a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194" gracePeriod=30
Oct 30 22:08:26.402639 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.402567    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:26.615611 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.615586    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:08:26.725617 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.725584    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ce56670-6071-44a1-a588-9fa0f0a34598-kube-api-access-nqpd9\" (UniqueName: \"kubernetes.io/projected/6ce56670-6071-44a1-a588-9fa0f0a34598-kube-api-access-nqpd9\") pod \"6ce56670-6071-44a1-a588-9fa0f0a34598\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") "
Oct 30 22:08:26.725836 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.725821    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls\") pod \"6ce56670-6071-44a1-a588-9fa0f0a34598\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") "
Oct 30 22:08:26.725905 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.725853    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ce56670-6071-44a1-a588-9fa0f0a34598-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce56670-6071-44a1-a588-9fa0f0a34598-openshift-service-ca\") pod \"6ce56670-6071-44a1-a588-9fa0f0a34598\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") "
Oct 30 22:08:26.725905 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.725877    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-metrics-certs\") pod \"6ce56670-6071-44a1-a588-9fa0f0a34598\" (UID: \"6ce56670-6071-44a1-a588-9fa0f0a34598\") "
Oct 30 22:08:26.726257 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.726225    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce56670-6071-44a1-a588-9fa0f0a34598-openshift-service-ca" pod "6ce56670-6071-44a1-a588-9fa0f0a34598" (UID: "6ce56670-6071-44a1-a588-9fa0f0a34598"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:08:26.726401 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.726388    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce56670-6071-44a1-a588-9fa0f0a34598-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:26.728036 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.728015    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce56670-6071-44a1-a588-9fa0f0a34598-kube-api-access-nqpd9" pod "6ce56670-6071-44a1-a588-9fa0f0a34598" (UID: "6ce56670-6071-44a1-a588-9fa0f0a34598"). InnerVolumeSpecName "kube-api-access-nqpd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:08:26.728209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.728186    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-metrics-certs" pod "6ce56670-6071-44a1-a588-9fa0f0a34598" (UID: "6ce56670-6071-44a1-a588-9fa0f0a34598"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:08:26.728314 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.728241    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls" pod "6ce56670-6071-44a1-a588-9fa0f0a34598" (UID: "6ce56670-6071-44a1-a588-9fa0f0a34598"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:08:26.827894 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.827822    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:26.827894 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.827851    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce56670-6071-44a1-a588-9fa0f0a34598-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:26.827894 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:26.827863    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqpd9\" (UniqueName: \"kubernetes.io/projected/6ce56670-6071-44a1-a588-9fa0f0a34598-kube-api-access-nqpd9\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:27.052995 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.052922    5575 generic.go:356] "Generic (PLEG): container finished" podID="6ce56670-6071-44a1-a588-9fa0f0a34598" containerID="a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194" exitCode=0
Oct 30 22:08:27.052995 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.052993    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"
Oct 30 22:08:27.053225 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.053003    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5" event={"ID":"6ce56670-6071-44a1-a588-9fa0f0a34598","Type":"ContainerDied","Data":"a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194"}
Oct 30 22:08:27.053225 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.053059    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5" event={"ID":"6ce56670-6071-44a1-a588-9fa0f0a34598","Type":"ContainerDied","Data":"7231ef6296a41e653101a78e68e4c842bdfc5250a22d30be24c0ec9b9e4957bf"}
Oct 30 22:08:27.053225 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.053085    5575 scope.go:122] "RemoveContainer" containerID="a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194"
Oct 30 22:08:27.065421 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.065399    5575 scope.go:122] "RemoveContainer" containerID="a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194"
Oct 30 22:08:27.065682 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:08:27.065663    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194\": container with ID starting with a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194 not found: ID does not exist" containerID="a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194"
Oct 30 22:08:27.065732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.065691    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194"} err="failed to get container status \"a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194\": rpc error: code = NotFound desc = could not find container \"a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194\": container with ID starting with a6a6350d288c889c0605992134169ed28a7fd145e02c95a029aa0a1aa19be194 not found: ID does not exist"
Oct 30 22:08:27.276479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.258400    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"]
Oct 30 22:08:27.297985 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.293733    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-98d38f-c7f79f999-nwsd5"]
Oct 30 22:08:27.588900 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.588809    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:27.928569 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:27.928534    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:28.238402 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:28.238304    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:28.907451 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:28.907410    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:29.128268 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:29.128198    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ce56670-6071-44a1-a588-9fa0f0a34598" path="/var/lib/kubelet/pods/6ce56670-6071-44a1-a588-9fa0f0a34598/volumes"
Oct 30 22:08:29.285773 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:29.285685    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:29.567131 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:29.567053    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:29.775938 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:29.775901    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:30.324139 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:30.324105    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:31.660388 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:31.660283    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"]
Oct 30 22:08:31.660920 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:31.660735    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" containerID="cri-o://012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b" gracePeriod=30
Oct 30 22:08:34.042064 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:34.042020    5575 patch_prober.go:29] interesting pod/e2e-worker-w5-c7d477-openshift-default-776595695-86v24 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:08:34.042470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:34.042129    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:08:34.829693 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:34.829659    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:36.196513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.196478    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:36.427482 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.427449    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:36.524912 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.524824    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"]
Oct 30 22:08:36.525111 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.525086    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy" containerID="cri-o://d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f" gracePeriod=30
Oct 30 22:08:36.600789 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.600757    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:36.941955 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.941924    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 22:08:36.976563 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.976535    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-podinfo\") pod \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") "
Oct 30 22:08:36.976746 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.976603    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-token\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-token\") pod \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") "
Oct 30 22:08:36.976746 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.976627    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-socket\") pod \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") "
Oct 30 22:08:36.976746 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.976660    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-credential-socket\") pod \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") "
Oct 30 22:08:36.976746 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.976699    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istiod-ca-cert\") pod \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") "
Oct 30 22:08:36.976926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.976756    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-data\") pod \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") "
Oct 30 22:08:36.976926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.976841    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-certs\") pod \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") "
Oct 30 22:08:36.976926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.976900    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-kube-api-access-g2pzv\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-kube-api-access-g2pzv\") pod \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") "
Oct 30 22:08:36.977144 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.976931    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-envoy\") pod \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\" (UID: \"8d6ef7d2-249f-4d93-af89-15af3a2cebfc\") "
Oct 30 22:08:36.977144 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977001    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-credential-socket" pod "8d6ef7d2-249f-4d93-af89-15af3a2cebfc" (UID: "8d6ef7d2-249f-4d93-af89-15af3a2cebfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:36.977144 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977033    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-socket" pod "8d6ef7d2-249f-4d93-af89-15af3a2cebfc" (UID: "8d6ef7d2-249f-4d93-af89-15af3a2cebfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:36.977316 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977201    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-certs" pod "8d6ef7d2-249f-4d93-af89-15af3a2cebfc" (UID: "8d6ef7d2-249f-4d93-af89-15af3a2cebfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:36.977316 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977235    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istiod-ca-cert" pod "8d6ef7d2-249f-4d93-af89-15af3a2cebfc" (UID: "8d6ef7d2-249f-4d93-af89-15af3a2cebfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:08:36.977492 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977469    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-data" pod "8d6ef7d2-249f-4d93-af89-15af3a2cebfc" (UID: "8d6ef7d2-249f-4d93-af89-15af3a2cebfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:36.977616 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977577    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:36.977616 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977605    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:36.977696 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977648    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:36.977815 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977743    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:36.977815 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.977811    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:36.979273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.979247    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-envoy" pod "8d6ef7d2-249f-4d93-af89-15af3a2cebfc" (UID: "8d6ef7d2-249f-4d93-af89-15af3a2cebfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:36.979376 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.979275    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-kube-api-access-g2pzv" pod "8d6ef7d2-249f-4d93-af89-15af3a2cebfc" (UID: "8d6ef7d2-249f-4d93-af89-15af3a2cebfc"). InnerVolumeSpecName "kube-api-access-g2pzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:08:36.979554 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.979531    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-podinfo" pod "8d6ef7d2-249f-4d93-af89-15af3a2cebfc" (UID: "8d6ef7d2-249f-4d93-af89-15af3a2cebfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:08:36.979650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:36.979552    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-token" pod "8d6ef7d2-249f-4d93-af89-15af3a2cebfc" (UID: "8d6ef7d2-249f-4d93-af89-15af3a2cebfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:08:37.079503 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.079426    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2pzv\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-kube-api-access-g2pzv\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:37.079503 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.079469    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:37.079503 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.079484    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:37.079503 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.079500    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d6ef7d2-249f-4d93-af89-15af3a2cebfc-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:37.147723 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.147695    5575 generic.go:356] "Generic (PLEG): container finished" podID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerID="012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b" exitCode=0
Oct 30 22:08:37.147891 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.147738    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"
Oct 30 22:08:37.147891 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.147782    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" event={"ID":"8d6ef7d2-249f-4d93-af89-15af3a2cebfc","Type":"ContainerDied","Data":"012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b"}
Oct 30 22:08:37.147891 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.147836    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24" event={"ID":"8d6ef7d2-249f-4d93-af89-15af3a2cebfc","Type":"ContainerDied","Data":"6cba4780004b2d5e234c5b9226ef6b4fba07fa08581d6b71b03eb4c838ff8168"}
Oct 30 22:08:37.147891 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.147868    5575 scope.go:122] "RemoveContainer" containerID="012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b"
Oct 30 22:08:37.160070 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.160050    5575 scope.go:122] "RemoveContainer" containerID="012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b"
Oct 30 22:08:37.160424 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:08:37.160403    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b\": container with ID starting with 012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b not found: ID does not exist" containerID="012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b"
Oct 30 22:08:37.160496 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.160432    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b"} err="failed to get container status \"012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b\": rpc error: code = NotFound desc = could not find container \"012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b\": container with ID starting with 012540d110767a7e6584bb50f49d3063d78c45194b78467ff6d130986582ad6b not found: ID does not exist"
Oct 30 22:08:37.319776 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.319739    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"]
Oct 30 22:08:37.323296 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.323266    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-86v24"]
Oct 30 22:08:37.728682 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.728641    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:37.906354 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:37.906324    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:38.088421 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:38.088326    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:39.130469 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:39.130432    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" path="/var/lib/kubelet/pods/8d6ef7d2-249f-4d93-af89-15af3a2cebfc/volumes"
Oct 30 22:08:39.993359 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:39.993309    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:41.801463 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.801410    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:08:41.838921 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.838888    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-envoy\") pod \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") "
Oct 30 22:08:41.839114 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.838952    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istiod-ca-cert\") pod \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") "
Oct 30 22:08:41.839114 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.839060    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-podinfo\") pod \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") "
Oct 30 22:08:41.839114 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.839098    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-token\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-token\") pod \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") "
Oct 30 22:08:41.839273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.839156    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-socket\") pod \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") "
Oct 30 22:08:41.839273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.839198    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-credential-socket\") pod \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") "
Oct 30 22:08:41.839273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.839224    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-certs\") pod \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") "
Oct 30 22:08:41.839416 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.839281    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-kube-api-access-bncmh\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-kube-api-access-bncmh\") pod \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") "
Oct 30 22:08:41.839463 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.839413    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-data\") pod \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\" (UID: \"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc\") "
Oct 30 22:08:41.839533 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.839505    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-credential-socket" pod "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" (UID: "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:41.840069 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.839907    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:41.840225 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.840158    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-data" pod "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" (UID: "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:41.841479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.841441    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istiod-ca-cert" pod "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" (UID: "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:08:41.841664 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.841637    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-socket" pod "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" (UID: "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:41.841829 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.841778    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-certs" pod "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" (UID: "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:41.844050 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.844014    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-envoy" pod "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" (UID: "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:08:41.844152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.844098    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-token" pod "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" (UID: "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:08:41.844233 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.844207    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-podinfo" pod "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" (UID: "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:08:41.844621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.844598    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-kube-api-access-bncmh" pod "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" (UID: "ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc"). InnerVolumeSpecName "kube-api-access-bncmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:08:41.941659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.941619    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:41.941659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.941646    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:41.941659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.941658    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:41.941659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.941668    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bncmh\" (UniqueName: \"kubernetes.io/projected/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-kube-api-access-bncmh\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:41.942029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.941677    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:41.942029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.941685    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:41.942029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.941693    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:41.942029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:41.941703    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:08:42.242675 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.242643    5575 generic.go:356] "Generic (PLEG): container finished" podID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerID="d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f" exitCode=0
Oct 30 22:08:42.242860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.242693    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"
Oct 30 22:08:42.242860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.242729    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" event={"ID":"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc","Type":"ContainerDied","Data":"d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f"}
Oct 30 22:08:42.242860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.242788    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d" event={"ID":"ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc","Type":"ContainerDied","Data":"f7831a5b423985e9f984d53c4b0b36f0a3493778ee75ab94504b108354a41dad"}
Oct 30 22:08:42.242860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.242817    5575 scope.go:122] "RemoveContainer" containerID="d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f"
Oct 30 22:08:42.255104 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.255083    5575 scope.go:122] "RemoveContainer" containerID="8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a"
Oct 30 22:08:42.266847 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.266829    5575 scope.go:122] "RemoveContainer" containerID="d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f"
Oct 30 22:08:42.267145 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:08:42.267126    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f\": container with ID starting with d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f not found: ID does not exist" containerID="d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f"
Oct 30 22:08:42.267212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.267154    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f"} err="failed to get container status \"d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f\": rpc error: code = NotFound desc = could not find container \"d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f\": container with ID starting with d40cbe196903e3e8ff51fe42f64bbcb887fafbf8646effabd3297a00e62b2f3f not found: ID does not exist"
Oct 30 22:08:42.267212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.267172    5575 scope.go:122] "RemoveContainer" containerID="8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a"
Oct 30 22:08:42.267419 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:08:42.267398    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a\": container with ID starting with 8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a not found: ID does not exist" containerID="8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a"
Oct 30 22:08:42.267463 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.267424    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a"} err="failed to get container status \"8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a\": rpc error: code = NotFound desc = could not find container \"8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a\": container with ID starting with 8245958ded6466085436549b6742a2b13a80d08a0860c936194466bf7192835a not found: ID does not exist"
Oct 30 22:08:42.415396 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.415371    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"]
Oct 30 22:08:42.418584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:42.418562    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-98d38f-openshift-default-849d69489c-86r2d"]
Oct 30 22:08:43.127270 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:43.127235    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" path="/var/lib/kubelet/pods/ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc/volumes"
Oct 30 22:08:45.460900 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:45.460852    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:49.539200 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:49.539163    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:49.766333 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:49.766294    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:49.987405 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:49.987363    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:51.375813 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:51.375773    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:51.648024 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:51.647933    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:51.876740 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:51.876647    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:52.070854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:52.070764    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:52.277886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:52.277851    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:53.513161 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:08:53.513122    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:08:56.724466 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:56.724432    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:57.139857 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:08:57.139822    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:02.355239 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:02.355183    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:02.585077 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:02.585025    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:03.344849 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:03.344817    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:03.545098 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:03.545058    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:07.392999 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:07.392938    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:08.557343 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:08.557286    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:08.825692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:08.825595    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:09.015358 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:09.015329    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:12.311319 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:12.311276    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:17.357038 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:17.356993    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:19.492019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:19.491987    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:22.427054 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:22.427013    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:23.488902 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:09:23.488865    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:09:24.444242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:24.444211    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"]
Oct 30 22:09:24.493279 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:24.493248    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"]
Oct 30 22:09:24.604427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:24.604392    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:27.616018 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:27.615955    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:31.940863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:31.940827    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:32.107540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:32.107481    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:33.495085 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:33.495049    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:33.774956 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:33.774868    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:33.931401 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:33.931367    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:34.407918 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:34.407884    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:35.670204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:35.670172    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:35.961999 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:35.961907    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:38.636171 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.636135    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"]
Oct 30 22:09:38.636713 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.636369    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g" podUID="24f62908-0b2f-4d38-841e-239162d48954" containerName="maas-api" containerID="cri-o://2e6fbd8e0b3c4e9d751b4bbd5f577f8f358906e024a8177aebaf98867ec9662f" gracePeriod=30
Oct 30 22:09:38.749072 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.749006    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:38.781065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.781025    5575 generic.go:356] "Generic (PLEG): container finished" podID="24f62908-0b2f-4d38-841e-239162d48954" containerID="2e6fbd8e0b3c4e9d751b4bbd5f577f8f358906e024a8177aebaf98867ec9662f" exitCode=0
Oct 30 22:09:38.781268 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.781220    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g" event={"ID":"24f62908-0b2f-4d38-841e-239162d48954","Type":"ContainerDied","Data":"2e6fbd8e0b3c4e9d751b4bbd5f577f8f358906e024a8177aebaf98867ec9662f"}
Oct 30 22:09:38.940879 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.940853    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:09:38.976940 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.976905    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls\") pod \"24f62908-0b2f-4d38-841e-239162d48954\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") "
Oct 30 22:09:38.977106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.976959    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24f62908-0b2f-4d38-841e-239162d48954-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f62908-0b2f-4d38-841e-239162d48954-openshift-service-ca\") pod \"24f62908-0b2f-4d38-841e-239162d48954\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") "
Oct 30 22:09:38.977106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.977027    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-metrics-certs\") pod \"24f62908-0b2f-4d38-841e-239162d48954\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") "
Oct 30 22:09:38.977197 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.977139    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24f62908-0b2f-4d38-841e-239162d48954-kube-api-access-mtkmf\" (UniqueName: \"kubernetes.io/projected/24f62908-0b2f-4d38-841e-239162d48954-kube-api-access-mtkmf\") pod \"24f62908-0b2f-4d38-841e-239162d48954\" (UID: \"24f62908-0b2f-4d38-841e-239162d48954\") "
Oct 30 22:09:38.977380 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.977351    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24f62908-0b2f-4d38-841e-239162d48954-openshift-service-ca" pod "24f62908-0b2f-4d38-841e-239162d48954" (UID: "24f62908-0b2f-4d38-841e-239162d48954"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:09:38.977540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.977524    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f62908-0b2f-4d38-841e-239162d48954-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:38.979364 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.979337    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls" pod "24f62908-0b2f-4d38-841e-239162d48954" (UID: "24f62908-0b2f-4d38-841e-239162d48954"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:09:38.979840 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.979818    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-metrics-certs" pod "24f62908-0b2f-4d38-841e-239162d48954" (UID: "24f62908-0b2f-4d38-841e-239162d48954"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:09:38.979927 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:38.979851    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f62908-0b2f-4d38-841e-239162d48954-kube-api-access-mtkmf" pod "24f62908-0b2f-4d38-841e-239162d48954" (UID: "24f62908-0b2f-4d38-841e-239162d48954"). InnerVolumeSpecName "kube-api-access-mtkmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:09:39.078780 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.078740    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:39.078780 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.078779    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f62908-0b2f-4d38-841e-239162d48954-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:39.079108 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.078797    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtkmf\" (UniqueName: \"kubernetes.io/projected/24f62908-0b2f-4d38-841e-239162d48954-kube-api-access-mtkmf\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:39.466786 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.466740    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main" containerID="cri-o://c72d5ecc7853d7e900d9c73680dd35b4b396a1e800602506104e8e70e0690a34" gracePeriod=45
Oct 30 22:09:39.515403 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.515355    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main" containerID="cri-o://592c7a17801df68ba9032df9f6777e50ae10f4da308be2143bdab442023aabf4" gracePeriod=45
Oct 30 22:09:39.792398 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.792366    5575 generic.go:356] "Generic (PLEG): container finished" podID="3cc981be-9931-4457-a0e6-17fab076f721" containerID="c72d5ecc7853d7e900d9c73680dd35b4b396a1e800602506104e8e70e0690a34" exitCode=0
Oct 30 22:09:39.792875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.792541    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" event={"ID":"3cc981be-9931-4457-a0e6-17fab076f721","Type":"ContainerDied","Data":"c72d5ecc7853d7e900d9c73680dd35b4b396a1e800602506104e8e70e0690a34"}
Oct 30 22:09:39.794996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.794533    5575 generic.go:356] "Generic (PLEG): container finished" podID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerID="592c7a17801df68ba9032df9f6777e50ae10f4da308be2143bdab442023aabf4" exitCode=0
Oct 30 22:09:39.795315 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.795287    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" event={"ID":"e39a3fa7-4979-4555-ac5a-1ab836e7eb98","Type":"ContainerDied","Data":"592c7a17801df68ba9032df9f6777e50ae10f4da308be2143bdab442023aabf4"}
Oct 30 22:09:39.797002 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.796978    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g" event={"ID":"24f62908-0b2f-4d38-841e-239162d48954","Type":"ContainerDied","Data":"f038c833268f9811f948b916259bb78bcfd75431a9acd6bb93af17083085bd1c"}
Oct 30 22:09:39.797087 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.797036    5575 scope.go:122] "RemoveContainer" containerID="2e6fbd8e0b3c4e9d751b4bbd5f577f8f358906e024a8177aebaf98867ec9662f"
Oct 30 22:09:39.797199 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.797186    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"
Oct 30 22:09:39.862258 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.862223    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 22:09:39.898947 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.898916    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-dshm\") pod \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") "
Oct 30 22:09:39.899117 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.899054    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-model-cache\") pod \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") "
Oct 30 22:09:39.899117 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.899105    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-kube-api-access-94d94\" (UniqueName: \"kubernetes.io/projected/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-kube-api-access-94d94\") pod \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") "
Oct 30 22:09:39.899234 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.899142    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tmp-dir\") pod \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") "
Oct 30 22:09:39.899296 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.899244    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-home\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-home\") pod \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") "
Oct 30 22:09:39.899357 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.899298    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tls-certs\" (UniqueName: \"kubernetes.io/secret/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tls-certs\") pod \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\" (UID: \"e39a3fa7-4979-4555-ac5a-1ab836e7eb98\") "
Oct 30 22:09:39.899357 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.899304    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-model-cache" pod "e39a3fa7-4979-4555-ac5a-1ab836e7eb98" (UID: "e39a3fa7-4979-4555-ac5a-1ab836e7eb98"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:09:39.899624 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.899599    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tmp-dir" pod "e39a3fa7-4979-4555-ac5a-1ab836e7eb98" (UID: "e39a3fa7-4979-4555-ac5a-1ab836e7eb98"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:09:39.899806 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.899743    5575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-model-cache\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:39.899904 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.899814    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-home" pod "e39a3fa7-4979-4555-ac5a-1ab836e7eb98" (UID: "e39a3fa7-4979-4555-ac5a-1ab836e7eb98"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:09:39.901551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.901528    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-dshm" pod "e39a3fa7-4979-4555-ac5a-1ab836e7eb98" (UID: "e39a3fa7-4979-4555-ac5a-1ab836e7eb98"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:09:39.901766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.901744    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-kube-api-access-94d94" pod "e39a3fa7-4979-4555-ac5a-1ab836e7eb98" (UID: "e39a3fa7-4979-4555-ac5a-1ab836e7eb98"). InnerVolumeSpecName "kube-api-access-94d94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:09:39.902104 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.902072    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tls-certs" pod "e39a3fa7-4979-4555-ac5a-1ab836e7eb98" (UID: "e39a3fa7-4979-4555-ac5a-1ab836e7eb98"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:09:39.917649 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.917621    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 22:09:39.974905 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:39.974867    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"]
Oct 30 22:09:40.000335 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.000262    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-home\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-home\") pod \"3cc981be-9931-4457-a0e6-17fab076f721\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") "
Oct 30 22:09:40.000335 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.000310    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-dshm\") pod \"3cc981be-9931-4457-a0e6-17fab076f721\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") "
Oct 30 22:09:40.000552 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.000338    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-tmp-dir\") pod \"3cc981be-9931-4457-a0e6-17fab076f721\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") "
Oct 30 22:09:40.000552 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.000378    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3cc981be-9931-4457-a0e6-17fab076f721-tls-certs\" (UniqueName: \"kubernetes.io/secret/3cc981be-9931-4457-a0e6-17fab076f721-tls-certs\") pod \"3cc981be-9931-4457-a0e6-17fab076f721\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") "
Oct 30 22:09:40.000552 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.000446    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-model-cache\") pod \"3cc981be-9931-4457-a0e6-17fab076f721\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") "
Oct 30 22:09:40.000706 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.000589    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-home" pod "3cc981be-9931-4457-a0e6-17fab076f721" (UID: "3cc981be-9931-4457-a0e6-17fab076f721"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:09:40.000706 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.000628    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-tmp-dir" pod "3cc981be-9931-4457-a0e6-17fab076f721" (UID: "3cc981be-9931-4457-a0e6-17fab076f721"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:09:40.000706 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.000640    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3cc981be-9931-4457-a0e6-17fab076f721-kube-api-access-fdfw5\" (UniqueName: \"kubernetes.io/projected/3cc981be-9931-4457-a0e6-17fab076f721-kube-api-access-fdfw5\") pod \"3cc981be-9931-4457-a0e6-17fab076f721\" (UID: \"3cc981be-9931-4457-a0e6-17fab076f721\") "
Oct 30 22:09:40.000880 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.000866    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-model-cache" pod "3cc981be-9931-4457-a0e6-17fab076f721" (UID: "3cc981be-9931-4457-a0e6-17fab076f721"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:09:40.001374 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.001350    5575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-home\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.001374 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.001376    5575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-home\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.001540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.001390    5575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tls-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.001540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.001404    5575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-tmp-dir\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.001540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.001418    5575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-model-cache\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.001540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.001432    5575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-dshm\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.001540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.001447    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94d94\" (UniqueName: \"kubernetes.io/projected/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-kube-api-access-94d94\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.001540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.001463    5575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39a3fa7-4979-4555-ac5a-1ab836e7eb98-tmp-dir\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.002750 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.002725    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cc981be-9931-4457-a0e6-17fab076f721-tls-certs" pod "3cc981be-9931-4457-a0e6-17fab076f721" (UID: "3cc981be-9931-4457-a0e6-17fab076f721"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:09:40.002830 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.002749    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-dshm" pod "3cc981be-9931-4457-a0e6-17fab076f721" (UID: "3cc981be-9931-4457-a0e6-17fab076f721"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:09:40.002945 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.002928    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc981be-9931-4457-a0e6-17fab076f721-kube-api-access-fdfw5" pod "3cc981be-9931-4457-a0e6-17fab076f721" (UID: "3cc981be-9931-4457-a0e6-17fab076f721"). InnerVolumeSpecName "kube-api-access-fdfw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:09:40.023916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.023889    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a19c1-98d6bf75d-tjk6g"]
Oct 30 22:09:40.102387 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.102341    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdfw5\" (UniqueName: \"kubernetes.io/projected/3cc981be-9931-4457-a0e6-17fab076f721-kube-api-access-fdfw5\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.102387 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.102381    5575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cc981be-9931-4457-a0e6-17fab076f721-dshm\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.102387 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.102395    5575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cc981be-9931-4457-a0e6-17fab076f721-tls-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:09:40.338115 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.338042    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:40.568780 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.568746    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:40.743708 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.743666    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:40.807696 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.807668    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"
Oct 30 22:09:40.807696 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.807677    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq" event={"ID":"3cc981be-9931-4457-a0e6-17fab076f721","Type":"ContainerDied","Data":"d6a992f42ddecb0cbaf40d01116ec46bb9aad13403eb8ad00989c6af87f8fd3f"}
Oct 30 22:09:40.808264 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.807730    5575 scope.go:122] "RemoveContainer" containerID="c72d5ecc7853d7e900d9c73680dd35b4b396a1e800602506104e8e70e0690a34"
Oct 30 22:09:40.809435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.809418    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"
Oct 30 22:09:40.809573 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.809423    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx" event={"ID":"e39a3fa7-4979-4555-ac5a-1ab836e7eb98","Type":"ContainerDied","Data":"27e8649a8892182adc876845345a9fbfd86a27e00a5cbe4a3fd155c0f474d863"}
Oct 30 22:09:40.822205 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.822190    5575 scope.go:122] "RemoveContainer" containerID="592c7a17801df68ba9032df9f6777e50ae10f4da308be2143bdab442023aabf4"
Oct 30 22:09:40.987131 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.987053    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"]
Oct 30 22:09:40.990440 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:40.990341    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-691598/premium-w0-691598-kserve-6849c644d8-zpkmx"]
Oct 30 22:09:41.073099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:41.073061    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:41.102718 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:41.102693    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"]
Oct 30 22:09:41.105805 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:41.105784    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-691598/distinct-w0-691598-kserve-64f7b6f78c-sgrcq"]
Oct 30 22:09:41.143955 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:41.143923    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24f62908-0b2f-4d38-841e-239162d48954" path="/var/lib/kubelet/pods/24f62908-0b2f-4d38-841e-239162d48954/volumes"
Oct 30 22:09:41.144403 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:41.144388    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3cc981be-9931-4457-a0e6-17fab076f721" path="/var/lib/kubelet/pods/3cc981be-9931-4457-a0e6-17fab076f721/volumes"
Oct 30 22:09:41.144779 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:41.144763    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" path="/var/lib/kubelet/pods/e39a3fa7-4979-4555-ac5a-1ab836e7eb98/volumes"
Oct 30 22:09:41.274375 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:41.274298    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:41.455494 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:41.455457    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:41.982614 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:41.982577    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:45.887642 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:45.887608    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:47.052170 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:47.052126    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:50.970891 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:50.970856    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:51.274429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:51.274349    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:53.487081 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:09:53.487041    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:09:54.114769 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:54.114726    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"]
Oct 30 22:09:54.377921 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:54.377841    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:54.532781 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:54.532732    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:55.718004 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:55.717955    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:56.711532 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:56.711495    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:57.049390 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:57.049285    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:58.772877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:58.772825    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:58.940227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:58.940195    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:59.115887 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:59.115782    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs" podUID="59e5cb43-78bd-49b5-aabf-fda9c2bdee80" containerName="payload-pre-processing" containerID="cri-o://99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b" gracePeriod=25
Oct 30 22:09:59.134751 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:59.134725    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:59.136469 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:59.136443    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"]
Oct 30 22:09:59.136626 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:59.136607    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy" containerID="cri-o://90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743" gracePeriod=30
Oct 30 22:09:59.647886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:09:59.647854    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:00.987464 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:00.987432    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:01.503589 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:01.503560    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:03.023555 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:03.023504    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:03.234643 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:03.234602    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:03.474663 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:03.474635    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:04.434672 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.434640    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:10:04.535341 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535313    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-socket\") pod \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") "
Oct 30 22:10:04.535511 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535384    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-certs\") pod \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") "
Oct 30 22:10:04.535511 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535417    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-token\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-token\") pod \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") "
Oct 30 22:10:04.535511 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535509    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-podinfo\") pod \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") "
Oct 30 22:10:04.535692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535527    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-kube-api-access-x9x9k\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-kube-api-access-x9x9k\") pod \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") "
Oct 30 22:10:04.535692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535567    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istiod-ca-cert\") pod \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") "
Oct 30 22:10:04.535692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535574    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-socket" pod "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" (UID: "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:04.535692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535619    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-envoy\") pod \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") "
Oct 30 22:10:04.535692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535654    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-data\") pod \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") "
Oct 30 22:10:04.535692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535687    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-credential-socket\") pod \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\" (UID: \"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf\") "
Oct 30 22:10:04.536060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535722    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-certs" pod "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" (UID: "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:04.536060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.535948    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-data" pod "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" (UID: "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:04.536060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.536037    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istiod-ca-cert" pod "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" (UID: "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:10:04.536198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.536178    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-credential-socket" pod "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" (UID: "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:04.536651 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.536544    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:04.536651 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.536618    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:04.536651 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.536637    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:04.536651 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.536653    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:04.536925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.536668    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:04.538102 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.538078    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-envoy" pod "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" (UID: "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:04.538191 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.538082    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-kube-api-access-x9x9k" pod "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" (UID: "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf"). InnerVolumeSpecName "kube-api-access-x9x9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:04.538191 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.538177    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-podinfo" pod "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" (UID: "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:10:04.538191 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.538174    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-token" pod "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" (UID: "8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:04.607731 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.607704    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"]
Oct 30 22:10:04.637992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.637953    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:04.638092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.637998    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:04.638092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.638015    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9x9k\" (UniqueName: \"kubernetes.io/projected/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-kube-api-access-x9x9k\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:04.638092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.638029    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:04.776039 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.775898    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:04.999030 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.998995    5575 generic.go:356] "Generic (PLEG): container finished" podID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerID="90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743" exitCode=0
Oct 30 22:10:04.999203 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.999047    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"
Oct 30 22:10:04.999203 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.999050    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" event={"ID":"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf","Type":"ContainerDied","Data":"90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743"}
Oct 30 22:10:04.999203 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.999171    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr" event={"ID":"8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf","Type":"ContainerDied","Data":"9462dbd181bd8ffaa53b1c8f07c6648ce08092da3e213027f14900d2e84abf65"}
Oct 30 22:10:04.999203 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:04.999195    5575 scope.go:122] "RemoveContainer" containerID="90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743"
Oct 30 22:10:05.012744 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:05.012721    5575 scope.go:122] "RemoveContainer" containerID="618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b"
Oct 30 22:10:05.024836 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:05.024810    5575 scope.go:122] "RemoveContainer" containerID="90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743"
Oct 30 22:10:05.025180 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:10:05.025160    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743\": container with ID starting with 90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743 not found: ID does not exist" containerID="90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743"
Oct 30 22:10:05.025236 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:05.025190    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743"} err="failed to get container status \"90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743\": rpc error: code = NotFound desc = could not find container \"90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743\": container with ID starting with 90a2926e9a89da7eb152b00916e9b5439592e8b8adf9522637deadd52a50b743 not found: ID does not exist"
Oct 30 22:10:05.025236 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:05.025208    5575 scope.go:122] "RemoveContainer" containerID="618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b"
Oct 30 22:10:05.025525 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:10:05.025502    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b\": container with ID starting with 618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b not found: ID does not exist" containerID="618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b"
Oct 30 22:10:05.025586 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:05.025537    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b"} err="failed to get container status \"618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b\": rpc error: code = NotFound desc = could not find container \"618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b\": container with ID starting with 618d2f144a25074e20c3258f67e96d235dacb836b644561c5ecb688cc06d841b not found: ID does not exist"
Oct 30 22:10:05.166513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:05.166484    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"]
Oct 30 22:10:05.173103 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:05.173083    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5a19c1-openshift-default-d646647-ldfmr"]
Oct 30 22:10:06.482583 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:06.482541    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:07.127312 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:07.127280    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" path="/var/lib/kubelet/pods/8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf/volumes"
Oct 30 22:10:07.318658 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:07.318619    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs" podUID="59e5cb43-78bd-49b5-aabf-fda9c2bdee80" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:10:09.815385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:09.815346    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:11.596459 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:11.596400    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:12.474331 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:12.474292    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:12.637013 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:12.636980    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:15.558422 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:15.558387    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:16.721809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:16.721766    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:17.319306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:17.319268    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs" podUID="59e5cb43-78bd-49b5-aabf-fda9c2bdee80" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:10:19.634635 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:19.634523    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" containerID="cri-o://54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5" gracePeriod=45
Oct 30 22:10:19.641333 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:19.641301    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 22:10:19.643416 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:19.643390    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-kube-api-access-z5mqv\" (UniqueName: \"kubernetes.io/projected/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-kube-api-access-z5mqv\") pod \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\" (UID: \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\") "
Oct 30 22:10:19.643576 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:19.643499    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-plugins-config-volume\") pod \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\" (UID: \"59e5cb43-78bd-49b5-aabf-fda9c2bdee80\") "
Oct 30 22:10:19.646311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:19.646282    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-plugins-config-volume" pod "59e5cb43-78bd-49b5-aabf-fda9c2bdee80" (UID: "59e5cb43-78bd-49b5-aabf-fda9c2bdee80"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:10:19.646424 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:19.646284    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-kube-api-access-z5mqv" pod "59e5cb43-78bd-49b5-aabf-fda9c2bdee80" (UID: "59e5cb43-78bd-49b5-aabf-fda9c2bdee80"). InnerVolumeSpecName "kube-api-access-z5mqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:19.746783 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:19.746740    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:19.746783 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:19.746787    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5mqv\" (UniqueName: \"kubernetes.io/projected/59e5cb43-78bd-49b5-aabf-fda9c2bdee80-kube-api-access-z5mqv\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:19.971009 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:19.970446    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 22:10:20.050324 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.050298    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/690910f5-0d9c-4dab-8de0-1eed27769236-kube-api-access-pqrkn\" (UniqueName: \"kubernetes.io/projected/690910f5-0d9c-4dab-8de0-1eed27769236-kube-api-access-pqrkn\") pod \"690910f5-0d9c-4dab-8de0-1eed27769236\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") "
Oct 30 22:10:20.050507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.050377    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/690910f5-0d9c-4dab-8de0-1eed27769236-tls-certs\" (UniqueName: \"kubernetes.io/secret/690910f5-0d9c-4dab-8de0-1eed27769236-tls-certs\") pod \"690910f5-0d9c-4dab-8de0-1eed27769236\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") "
Oct 30 22:10:20.050507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.050416    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-tmp-dir\") pod \"690910f5-0d9c-4dab-8de0-1eed27769236\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") "
Oct 30 22:10:20.050507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.050460    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-home\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-home\") pod \"690910f5-0d9c-4dab-8de0-1eed27769236\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") "
Oct 30 22:10:20.050507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.050500    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-model-cache\") pod \"690910f5-0d9c-4dab-8de0-1eed27769236\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") "
Oct 30 22:10:20.050738 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.050552    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-dshm\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-dshm\") pod \"690910f5-0d9c-4dab-8de0-1eed27769236\" (UID: \"690910f5-0d9c-4dab-8de0-1eed27769236\") "
Oct 30 22:10:20.050807 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.050731    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-home" pod "690910f5-0d9c-4dab-8de0-1eed27769236" (UID: "690910f5-0d9c-4dab-8de0-1eed27769236"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:20.050807 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.050765    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-tmp-dir" pod "690910f5-0d9c-4dab-8de0-1eed27769236" (UID: "690910f5-0d9c-4dab-8de0-1eed27769236"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:20.050908 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.050807    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-model-cache" pod "690910f5-0d9c-4dab-8de0-1eed27769236" (UID: "690910f5-0d9c-4dab-8de0-1eed27769236"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:20.051099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.051078    5575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-model-cache\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:20.051305 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.051265    5575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-tmp-dir\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:20.051305 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.051306    5575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-home\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:20.052911 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.052887    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-dshm" pod "690910f5-0d9c-4dab-8de0-1eed27769236" (UID: "690910f5-0d9c-4dab-8de0-1eed27769236"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:20.052911 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.052894    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/690910f5-0d9c-4dab-8de0-1eed27769236-tls-certs" pod "690910f5-0d9c-4dab-8de0-1eed27769236" (UID: "690910f5-0d9c-4dab-8de0-1eed27769236"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:10:20.053076 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.052998    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690910f5-0d9c-4dab-8de0-1eed27769236-kube-api-access-pqrkn" pod "690910f5-0d9c-4dab-8de0-1eed27769236" (UID: "690910f5-0d9c-4dab-8de0-1eed27769236"). InnerVolumeSpecName "kube-api-access-pqrkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:20.119705 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.119672    5575 generic.go:356] "Generic (PLEG): container finished" podID="690910f5-0d9c-4dab-8de0-1eed27769236" containerID="54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5" exitCode=0
Oct 30 22:10:20.119895 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.119734    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"
Oct 30 22:10:20.119895 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.119821    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" event={"ID":"690910f5-0d9c-4dab-8de0-1eed27769236","Type":"ContainerDied","Data":"54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5"}
Oct 30 22:10:20.119895 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.119852    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" event={"ID":"690910f5-0d9c-4dab-8de0-1eed27769236","Type":"ContainerDied","Data":"d7b9abcab29954a7df51fc3e7e622365a80ecb1dcbe6550e0b588358dd4238e3"}
Oct 30 22:10:20.119895 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.119872    5575 scope.go:122] "RemoveContainer" containerID="54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5"
Oct 30 22:10:20.122262 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.122239    5575 generic.go:356] "Generic (PLEG): container finished" podID="59e5cb43-78bd-49b5-aabf-fda9c2bdee80" containerID="99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b" exitCode=0
Oct 30 22:10:20.122383 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.122364    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs" event={"ID":"59e5cb43-78bd-49b5-aabf-fda9c2bdee80","Type":"ContainerDied","Data":"99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b"}
Oct 30 22:10:20.122465 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.122412    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs" event={"ID":"59e5cb43-78bd-49b5-aabf-fda9c2bdee80","Type":"ContainerDied","Data":"216de39294e18edabf36205b562c496d97ac5afbf1a6bd6189ea080ed659aa42"}
Oct 30 22:10:20.122465 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.122454    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"
Oct 30 22:10:20.153917 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.153866    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqrkn\" (UniqueName: \"kubernetes.io/projected/690910f5-0d9c-4dab-8de0-1eed27769236-kube-api-access-pqrkn\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:20.153917 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.153902    5575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/690910f5-0d9c-4dab-8de0-1eed27769236-tls-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:20.154065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.153919    5575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/690910f5-0d9c-4dab-8de0-1eed27769236-dshm\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:20.154065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.154012    5575 scope.go:122] "RemoveContainer" containerID="54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5"
Oct 30 22:10:20.154422 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:10:20.154395    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5\": container with ID starting with 54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5 not found: ID does not exist" containerID="54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5"
Oct 30 22:10:20.154525 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.154432    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5"} err="failed to get container status \"54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5\": rpc error: code = NotFound desc = could not find container \"54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5\": container with ID starting with 54b1fcd51b40af950bf7f427bf82a5a6df1f1026714c9f0b55c4bd7149ee9ce5 not found: ID does not exist"
Oct 30 22:10:20.154525 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.154456    5575 scope.go:122] "RemoveContainer" containerID="99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b"
Oct 30 22:10:20.168207 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.168188    5575 scope.go:122] "RemoveContainer" containerID="99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b"
Oct 30 22:10:20.168503 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:10:20.168479    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b\": container with ID starting with 99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b not found: ID does not exist" containerID="99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b"
Oct 30 22:10:20.168564 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.168503    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b"} err="failed to get container status \"99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b\": rpc error: code = NotFound desc = could not find container \"99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b\": container with ID starting with 99bc053e09ea4dbb2a178b6c5737234da02d316520fffcab8b62cabeebd2cb9b not found: ID does not exist"
Oct 30 22:10:20.290333 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.290256    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"]
Oct 30 22:10:20.298727 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.298697    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1de75a-7bc95cd7-zl5rs"]
Oct 30 22:10:20.411226 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.411193    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"]
Oct 30 22:10:20.416790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.416759    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh"]
Oct 30 22:10:20.886015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:20.885959    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-6ea374/distinct-w1-6ea374-kserve-55b6ff7866-qbhnh" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 22:10:21.126917 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:21.126884    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59e5cb43-78bd-49b5-aabf-fda9c2bdee80" path="/var/lib/kubelet/pods/59e5cb43-78bd-49b5-aabf-fda9c2bdee80/volumes"
Oct 30 22:10:21.127348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:21.127334    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" path="/var/lib/kubelet/pods/690910f5-0d9c-4dab-8de0-1eed27769236/volumes"
Oct 30 22:10:22.500513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:22.500476    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:23.496586 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:10:23.496550    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:10:23.506313 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:23.506287    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:23.843184 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:23.843093    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:25.837113 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:25.837081    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:26.670019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:26.669983    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"]
Oct 30 22:10:26.778781 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:26.778747    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"]
Oct 30 22:10:27.065132 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:27.065058    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:27.257766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:27.257690    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:28.066673 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:28.066637    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:31.671647 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:31.671578    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq" podUID="a3aedb2b-13cd-44ea-bb42-30d2c827aa8b" containerName="payload-processing" containerID="cri-o://339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3" gracePeriod=25
Oct 30 22:10:31.779948 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:31.779902    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg" podUID="49940fb5-e60d-4e3b-a2d9-fa539392a145" containerName="payload-pre-processing" containerID="cri-o://1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595" gracePeriod=25
Oct 30 22:10:31.973944 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:31.973920    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 22:10:31.998717 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:31.998687    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:32.098557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.098520    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-kube-api-access-jqfx5\" (UniqueName: \"kubernetes.io/projected/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-kube-api-access-jqfx5\") pod \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\" (UID: \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\") "
Oct 30 22:10:32.098741 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.098630    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-plugins-config-volume\") pod \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\" (UID: \"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b\") "
Oct 30 22:10:32.099047 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.099020    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-plugins-config-volume" pod "a3aedb2b-13cd-44ea-bb42-30d2c827aa8b" (UID: "a3aedb2b-13cd-44ea-bb42-30d2c827aa8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:10:32.099183 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.099163    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:32.101041 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.101012    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-kube-api-access-jqfx5" pod "a3aedb2b-13cd-44ea-bb42-30d2c827aa8b" (UID: "a3aedb2b-13cd-44ea-bb42-30d2c827aa8b"). InnerVolumeSpecName "kube-api-access-jqfx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:32.200544 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.200472    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqfx5\" (UniqueName: \"kubernetes.io/projected/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b-kube-api-access-jqfx5\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:32.249766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.249729    5575 generic.go:356] "Generic (PLEG): container finished" podID="a3aedb2b-13cd-44ea-bb42-30d2c827aa8b" containerID="339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3" exitCode=0
Oct 30 22:10:32.249920 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.249767    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"
Oct 30 22:10:32.249920 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.249807    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq" event={"ID":"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b","Type":"ContainerDied","Data":"339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3"}
Oct 30 22:10:32.249920 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.249868    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq" event={"ID":"a3aedb2b-13cd-44ea-bb42-30d2c827aa8b","Type":"ContainerDied","Data":"377e6975e05ec88f8eabfb76c4e39e9ac73d073b832a4deb4d1532776352598b"}
Oct 30 22:10:32.249920 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.249899    5575 scope.go:122] "RemoveContainer" containerID="339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3"
Oct 30 22:10:32.261217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.261200    5575 scope.go:122] "RemoveContainer" containerID="339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3"
Oct 30 22:10:32.261488 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:10:32.261465    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3\": container with ID starting with 339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3 not found: ID does not exist" containerID="339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3"
Oct 30 22:10:32.261545 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.261497    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3"} err="failed to get container status \"339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3\": rpc error: code = NotFound desc = could not find container \"339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3\": container with ID starting with 339d53f4bab4a1169c71d6eea69ae30bb1a58ee8fc2bb169304dc82122df78b3 not found: ID does not exist"
Oct 30 22:10:32.415538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.415510    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"]
Oct 30 22:10:32.418732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:32.418709    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-fd2a94-76485c8b84-8wkxq"]
Oct 30 22:10:33.002799 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:33.002769    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:33.127494 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:33.127460    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a3aedb2b-13cd-44ea-bb42-30d2c827aa8b" path="/var/lib/kubelet/pods/a3aedb2b-13cd-44ea-bb42-30d2c827aa8b/volumes"
Oct 30 22:10:37.907627 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:37.907593    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:38.646522 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:38.646484    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg" podUID="49940fb5-e60d-4e3b-a2d9-fa539392a145" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:10:41.685022 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:41.684985    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:41.862553 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:41.862522    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:42.937276 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:42.937242    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:43.092273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:43.092237    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:44.847394 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:44.847332    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:45.092079 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:45.092043    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:45.943402 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:45.943360    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:46.719180 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:46.719147    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:46.952593 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:46.952563    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:48.066921 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:48.066843    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:48.480836 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:48.480793    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:48.646442 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:48.646404    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg" podUID="49940fb5-e60d-4e3b-a2d9-fa539392a145" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:10:48.666638 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:48.666603    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:49.720810 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:49.720773    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:51.992877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:51.992848    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 22:10:52.028713 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.028674    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49940fb5-e60d-4e3b-a2d9-fa539392a145-kube-api-access-q9q9k\" (UniqueName: \"kubernetes.io/projected/49940fb5-e60d-4e3b-a2d9-fa539392a145-kube-api-access-q9q9k\") pod \"49940fb5-e60d-4e3b-a2d9-fa539392a145\" (UID: \"49940fb5-e60d-4e3b-a2d9-fa539392a145\") "
Oct 30 22:10:52.028883 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.028758    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49940fb5-e60d-4e3b-a2d9-fa539392a145-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49940fb5-e60d-4e3b-a2d9-fa539392a145-plugins-config-volume\") pod \"49940fb5-e60d-4e3b-a2d9-fa539392a145\" (UID: \"49940fb5-e60d-4e3b-a2d9-fa539392a145\") "
Oct 30 22:10:52.029212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.029180    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49940fb5-e60d-4e3b-a2d9-fa539392a145-plugins-config-volume" pod "49940fb5-e60d-4e3b-a2d9-fa539392a145" (UID: "49940fb5-e60d-4e3b-a2d9-fa539392a145"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:10:52.031072 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.031043    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49940fb5-e60d-4e3b-a2d9-fa539392a145-kube-api-access-q9q9k" pod "49940fb5-e60d-4e3b-a2d9-fa539392a145" (UID: "49940fb5-e60d-4e3b-a2d9-fa539392a145"). InnerVolumeSpecName "kube-api-access-q9q9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:52.130343 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.130296    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9q9k\" (UniqueName: \"kubernetes.io/projected/49940fb5-e60d-4e3b-a2d9-fa539392a145-kube-api-access-q9q9k\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:52.130591 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.130561    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49940fb5-e60d-4e3b-a2d9-fa539392a145-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:52.268004 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.267932    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"]
Oct 30 22:10:52.268217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.268180    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq" podUID="f30f0a55-5c94-4435-b49b-e3a62b8400db" containerName="maas-api" containerID="cri-o://2d62e19d1cd442b30cc707acc6c31642461db6ba1d27ee011edff4cead75b65d" gracePeriod=30
Oct 30 22:10:52.398056 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.398009    5575 generic.go:356] "Generic (PLEG): container finished" podID="49940fb5-e60d-4e3b-a2d9-fa539392a145" containerID="1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595" exitCode=0
Oct 30 22:10:52.398056 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.398043    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"
Oct 30 22:10:52.398242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.398083    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg" event={"ID":"49940fb5-e60d-4e3b-a2d9-fa539392a145","Type":"ContainerDied","Data":"1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595"}
Oct 30 22:10:52.398242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.398142    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg" event={"ID":"49940fb5-e60d-4e3b-a2d9-fa539392a145","Type":"ContainerDied","Data":"ebbc9b341b1d8cd045d8aa000b2935ae9a8c88a54579b880e740552b97492bda"}
Oct 30 22:10:52.398242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.398173    5575 scope.go:122] "RemoveContainer" containerID="1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595"
Oct 30 22:10:52.400794 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.400768    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:52.401026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.401000    5575 generic.go:356] "Generic (PLEG): container finished" podID="f30f0a55-5c94-4435-b49b-e3a62b8400db" containerID="2d62e19d1cd442b30cc707acc6c31642461db6ba1d27ee011edff4cead75b65d" exitCode=0
Oct 30 22:10:52.401233 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.401061    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq" event={"ID":"f30f0a55-5c94-4435-b49b-e3a62b8400db","Type":"ContainerDied","Data":"2d62e19d1cd442b30cc707acc6c31642461db6ba1d27ee011edff4cead75b65d"}
Oct 30 22:10:52.411649 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.411629    5575 scope.go:122] "RemoveContainer" containerID="1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595"
Oct 30 22:10:52.412269 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:10:52.412001    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595\": container with ID starting with 1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595 not found: ID does not exist" containerID="1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595"
Oct 30 22:10:52.412269 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.412037    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595"} err="failed to get container status \"1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595\": rpc error: code = NotFound desc = could not find container \"1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595\": container with ID starting with 1b8c9dea0e2a7af8d24de0b6148f82db69f2080e615bbb4589630bc799a46595 not found: ID does not exist"
Oct 30 22:10:52.578044 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.576881    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"]
Oct 30 22:10:52.582876 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.582831    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-fd2a94-74fbf698c5-gcdxg"]
Oct 30 22:10:52.620366 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.620331    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 22:10:52.639446 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.639416    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls\") pod \"f30f0a55-5c94-4435-b49b-e3a62b8400db\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") "
Oct 30 22:10:52.639638 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.639519    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f30f0a55-5c94-4435-b49b-e3a62b8400db-kube-api-access-9ckbh\" (UniqueName: \"kubernetes.io/projected/f30f0a55-5c94-4435-b49b-e3a62b8400db-kube-api-access-9ckbh\") pod \"f30f0a55-5c94-4435-b49b-e3a62b8400db\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") "
Oct 30 22:10:52.639714 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.639671    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f30f0a55-5c94-4435-b49b-e3a62b8400db-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f30f0a55-5c94-4435-b49b-e3a62b8400db-openshift-service-ca\") pod \"f30f0a55-5c94-4435-b49b-e3a62b8400db\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") "
Oct 30 22:10:52.639797 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.639774    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-metrics-certs\") pod \"f30f0a55-5c94-4435-b49b-e3a62b8400db\" (UID: \"f30f0a55-5c94-4435-b49b-e3a62b8400db\") "
Oct 30 22:10:52.640790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.640766    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30f0a55-5c94-4435-b49b-e3a62b8400db-openshift-service-ca" pod "f30f0a55-5c94-4435-b49b-e3a62b8400db" (UID: "f30f0a55-5c94-4435-b49b-e3a62b8400db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:10:52.642910 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.642882    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls" pod "f30f0a55-5c94-4435-b49b-e3a62b8400db" (UID: "f30f0a55-5c94-4435-b49b-e3a62b8400db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:10:52.643060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.643017    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30f0a55-5c94-4435-b49b-e3a62b8400db-kube-api-access-9ckbh" pod "f30f0a55-5c94-4435-b49b-e3a62b8400db" (UID: "f30f0a55-5c94-4435-b49b-e3a62b8400db"). InnerVolumeSpecName "kube-api-access-9ckbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:52.643628 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.643603    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-metrics-certs" pod "f30f0a55-5c94-4435-b49b-e3a62b8400db" (UID: "f30f0a55-5c94-4435-b49b-e3a62b8400db"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:10:52.741748 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.741714    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:52.741984 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.741948    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ckbh\" (UniqueName: \"kubernetes.io/projected/f30f0a55-5c94-4435-b49b-e3a62b8400db-kube-api-access-9ckbh\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:52.742114 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.742100    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f30f0a55-5c94-4435-b49b-e3a62b8400db-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:52.742204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:52.742193    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f30f0a55-5c94-4435-b49b-e3a62b8400db-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:10:53.127258 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:53.127189    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49940fb5-e60d-4e3b-a2d9-fa539392a145" path="/var/lib/kubelet/pods/49940fb5-e60d-4e3b-a2d9-fa539392a145/volumes"
Oct 30 22:10:53.411229 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:53.411191    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq" event={"ID":"f30f0a55-5c94-4435-b49b-e3a62b8400db","Type":"ContainerDied","Data":"d865d9275461b8c0c1bfd17a3f7d1f270a616a97be25ead72f237385fbedae5e"}
Oct 30 22:10:53.411229 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:53.411215    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"
Oct 30 22:10:53.411494 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:53.411275    5575 scope.go:122] "RemoveContainer" containerID="2d62e19d1cd442b30cc707acc6c31642461db6ba1d27ee011edff4cead75b65d"
Oct 30 22:10:53.486716 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:10:53.486678    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:10:53.607418 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:53.607379    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"]
Oct 30 22:10:53.629450 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:53.629418    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-691598-5dccf8b695-8rzsq"]
Oct 30 22:10:53.681149 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:53.681076    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:54.018833 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:54.018748    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:54.329824 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:54.329734    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:54.868522 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:54.868476    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:55.033335 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:55.033298    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:55.127124 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:55.127051    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f30f0a55-5c94-4435-b49b-e3a62b8400db" path="/var/lib/kubelet/pods/f30f0a55-5c94-4435-b49b-e3a62b8400db/volumes"
Oct 30 22:10:55.295417 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:55.295380    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:55.597291 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:55.597258    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:56.326674 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:56.326639    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:56.612931 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:56.612840    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:56.828473 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:56.828445    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:57.013274 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:57.013238    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:57.325078 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:57.324989    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:57.582322 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:57.582223    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:57.823399 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:57.823363    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:58.547932 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:58.547895    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"]
Oct 30 22:10:58.548201 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:58.548174    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy" containerID="cri-o://d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece" gracePeriod=30
Oct 30 22:10:58.597994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:58.597936    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"]
Oct 30 22:10:58.598182 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:58.598147    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy" containerID="cri-o://432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943" gracePeriod=30
Oct 30 22:10:58.600704 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:58.600670    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"]
Oct 30 22:10:58.600925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:58.600884    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy" containerID="cri-o://23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2" gracePeriod=30
Oct 30 22:10:58.649143 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:58.649112    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"]
Oct 30 22:10:58.649354 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:10:58.649330    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy" containerID="cri-o://4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271" gracePeriod=30
Oct 30 22:11:00.800085 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:00.800052    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:00.969068 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:00.969030    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:01.174705 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:01.174669    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"]
Oct 30 22:11:01.174888 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:01.174853    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy" containerID="cri-o://576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1" gracePeriod=30
Oct 30 22:11:01.182094 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:01.182070    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:01.975835 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:01.975799    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-4jscr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:11:01.976427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:01.975857    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:11:01.981390 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:01.981366    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:02.135592 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:02.135554    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:02.897424 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:02.897395    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:03.071579 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:03.071539    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:03.301075 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:03.300996    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"]
Oct 30 22:11:03.301243 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:03.301219    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy" containerID="cri-o://f871fd651ec050c38fb5d03755cb0540004f156a8e6a2f01a2bc9108f406e17a" gracePeriod=30
Oct 30 22:11:03.309709 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:03.309676    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:03.918991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:03.917438    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 22:11:03.984551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:03.984518    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 22:11:04.016185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.015715    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-data\") pod \"112686fc-ba64-40ff-8206-45381e35c8bc\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") "
Oct 30 22:11:04.016185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.015811    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/112686fc-ba64-40ff-8206-45381e35c8bc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112686fc-ba64-40ff-8206-45381e35c8bc-istiod-ca-cert\") pod \"112686fc-ba64-40ff-8206-45381e35c8bc\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") "
Oct 30 22:11:04.016185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.015863    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-istio-token\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-istio-token\") pod \"112686fc-ba64-40ff-8206-45381e35c8bc\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") "
Oct 30 22:11:04.016185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.015894    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-kube-api-access-s5f2f\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-kube-api-access-s5f2f\") pod \"112686fc-ba64-40ff-8206-45381e35c8bc\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") "
Oct 30 22:11:04.016185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.015929    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-envoy\") pod \"112686fc-ba64-40ff-8206-45381e35c8bc\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") "
Oct 30 22:11:04.016185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.016030    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-certs\") pod \"112686fc-ba64-40ff-8206-45381e35c8bc\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") "
Oct 30 22:11:04.016185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.016117    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-credential-socket\") pod \"112686fc-ba64-40ff-8206-45381e35c8bc\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") "
Oct 30 22:11:04.016657 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.016196    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-socket\") pod \"112686fc-ba64-40ff-8206-45381e35c8bc\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") "
Oct 30 22:11:04.016657 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.016240    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/112686fc-ba64-40ff-8206-45381e35c8bc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112686fc-ba64-40ff-8206-45381e35c8bc-istio-podinfo\") pod \"112686fc-ba64-40ff-8206-45381e35c8bc\" (UID: \"112686fc-ba64-40ff-8206-45381e35c8bc\") "
Oct 30 22:11:04.017606 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.017579    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112686fc-ba64-40ff-8206-45381e35c8bc-istiod-ca-cert" pod "112686fc-ba64-40ff-8206-45381e35c8bc" (UID: "112686fc-ba64-40ff-8206-45381e35c8bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:04.020329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.019048    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-data" pod "112686fc-ba64-40ff-8206-45381e35c8bc" (UID: "112686fc-ba64-40ff-8206-45381e35c8bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.020329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.019177    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-certs" pod "112686fc-ba64-40ff-8206-45381e35c8bc" (UID: "112686fc-ba64-40ff-8206-45381e35c8bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.020329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.019196    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-socket" pod "112686fc-ba64-40ff-8206-45381e35c8bc" (UID: "112686fc-ba64-40ff-8206-45381e35c8bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.020329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.020282    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-credential-socket" pod "112686fc-ba64-40ff-8206-45381e35c8bc" (UID: "112686fc-ba64-40ff-8206-45381e35c8bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.021997 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.021943    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/112686fc-ba64-40ff-8206-45381e35c8bc-istio-podinfo" pod "112686fc-ba64-40ff-8206-45381e35c8bc" (UID: "112686fc-ba64-40ff-8206-45381e35c8bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:04.027175 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.027130    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-envoy" pod "112686fc-ba64-40ff-8206-45381e35c8bc" (UID: "112686fc-ba64-40ff-8206-45381e35c8bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.027175 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.027139    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-kube-api-access-s5f2f" pod "112686fc-ba64-40ff-8206-45381e35c8bc" (UID: "112686fc-ba64-40ff-8206-45381e35c8bc"). InnerVolumeSpecName "kube-api-access-s5f2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:04.027175 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.027165    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-istio-token" pod "112686fc-ba64-40ff-8206-45381e35c8bc" (UID: "112686fc-ba64-40ff-8206-45381e35c8bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:04.035102 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.035082    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 22:11:04.038195 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.038173    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 22:11:04.117291 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117194    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-envoy\") pod \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") "
Oct 30 22:11:04.117291 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117259    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-envoy\") pod \"05a26d33-eb54-483f-8a0f-0951bbeda3db\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") "
Oct 30 22:11:04.117809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117293    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-socket\") pod \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") "
Oct 30 22:11:04.117809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117325    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05a26d33-eb54-483f-8a0f-0951bbeda3db-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a26d33-eb54-483f-8a0f-0951bbeda3db-istiod-ca-cert\") pod \"05a26d33-eb54-483f-8a0f-0951bbeda3db\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") "
Oct 30 22:11:04.117809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117360    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-certs\") pod \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") "
Oct 30 22:11:04.117809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117390    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-podinfo\") pod \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") "
Oct 30 22:11:04.117809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117428    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-data\") pod \"05a26d33-eb54-483f-8a0f-0951bbeda3db\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") "
Oct 30 22:11:04.117809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117693    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-certs" pod "95080aaa-0f44-42ea-aa2a-1ccddabbdce5" (UID: "95080aaa-0f44-42ea-aa2a-1ccddabbdce5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.117809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117765    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-envoy\") pod \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") "
Oct 30 22:11:04.118204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117831    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istiod-ca-cert\") pod \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") "
Oct 30 22:11:04.118204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117878    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-certs\") pod \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") "
Oct 30 22:11:04.118204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117915    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-token\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-token\") pod \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") "
Oct 30 22:11:04.118204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118006    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-podinfo\") pod \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") "
Oct 30 22:11:04.118204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118103    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-socket\") pod \"05a26d33-eb54-483f-8a0f-0951bbeda3db\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") "
Oct 30 22:11:04.118507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118203    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-token\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-token\") pod \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") "
Oct 30 22:11:04.118507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118240    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-data\") pod \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") "
Oct 30 22:11:04.118507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118282    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-socket\") pod \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") "
Oct 30 22:11:04.118507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118338    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-credential-socket\") pod \"05a26d33-eb54-483f-8a0f-0951bbeda3db\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") "
Oct 30 22:11:04.118507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118382    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-credential-socket\") pod \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") "
Oct 30 22:11:04.118507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118413    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istiod-ca-cert\") pod \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") "
Oct 30 22:11:04.118507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118473    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-credential-socket\") pod \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") "
Oct 30 22:11:04.118868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118554    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-kube-api-access-m4ssk\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-kube-api-access-m4ssk\") pod \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\" (UID: \"f5644e6e-0ed6-41af-8a49-ebfc16dd3923\") "
Oct 30 22:11:04.118868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118595    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-certs\") pod \"05a26d33-eb54-483f-8a0f-0951bbeda3db\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") "
Oct 30 22:11:04.118868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.117831    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a26d33-eb54-483f-8a0f-0951bbeda3db-istiod-ca-cert" pod "05a26d33-eb54-483f-8a0f-0951bbeda3db" (UID: "05a26d33-eb54-483f-8a0f-0951bbeda3db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:04.118868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118320    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-data" pod "05a26d33-eb54-483f-8a0f-0951bbeda3db" (UID: "05a26d33-eb54-483f-8a0f-0951bbeda3db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.118868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118646    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-kube-api-access-q2clq\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-kube-api-access-q2clq\") pod \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") "
Oct 30 22:11:04.118868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118703    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-podinfo\") pod \"05a26d33-eb54-483f-8a0f-0951bbeda3db\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") "
Oct 30 22:11:04.118868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118744    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-token\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-token\") pod \"05a26d33-eb54-483f-8a0f-0951bbeda3db\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") "
Oct 30 22:11:04.118868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118809    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-data\") pod \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\" (UID: \"95080aaa-0f44-42ea-aa2a-1ccddabbdce5\") "
Oct 30 22:11:04.118868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118843    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-kube-api-access-s96cw\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-kube-api-access-s96cw\") pod \"05a26d33-eb54-483f-8a0f-0951bbeda3db\" (UID: \"05a26d33-eb54-483f-8a0f-0951bbeda3db\") "
Oct 30 22:11:04.119498 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119473    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112686fc-ba64-40ff-8206-45381e35c8bc-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119566 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119505    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119680 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119657    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5f2f\" (UniqueName: \"kubernetes.io/projected/112686fc-ba64-40ff-8206-45381e35c8bc-kube-api-access-s5f2f\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119739 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119691    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119739 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119709    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119739 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119723    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a26d33-eb54-483f-8a0f-0951bbeda3db-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119887 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119737    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119887 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119752    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119887 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119767    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119887 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119782    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119887 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119797    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112686fc-ba64-40ff-8206-45381e35c8bc-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.119887 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.119811    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112686fc-ba64-40ff-8206-45381e35c8bc-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118367    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istiod-ca-cert" pod "f5644e6e-0ed6-41af-8a49-ebfc16dd3923" (UID: "f5644e6e-0ed6-41af-8a49-ebfc16dd3923"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118593    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-data" pod "f5644e6e-0ed6-41af-8a49-ebfc16dd3923" (UID: "f5644e6e-0ed6-41af-8a49-ebfc16dd3923"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118616    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-credential-socket" pod "05a26d33-eb54-483f-8a0f-0951bbeda3db" (UID: "05a26d33-eb54-483f-8a0f-0951bbeda3db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118753    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-socket" pod "05a26d33-eb54-483f-8a0f-0951bbeda3db" (UID: "05a26d33-eb54-483f-8a0f-0951bbeda3db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.118841    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-certs" pod "f5644e6e-0ed6-41af-8a49-ebfc16dd3923" (UID: "f5644e6e-0ed6-41af-8a49-ebfc16dd3923"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.120865    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-socket" pod "f5644e6e-0ed6-41af-8a49-ebfc16dd3923" (UID: "f5644e6e-0ed6-41af-8a49-ebfc16dd3923"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.120884    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-socket" pod "95080aaa-0f44-42ea-aa2a-1ccddabbdce5" (UID: "95080aaa-0f44-42ea-aa2a-1ccddabbdce5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.120986    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-envoy" pod "f5644e6e-0ed6-41af-8a49-ebfc16dd3923" (UID: "f5644e6e-0ed6-41af-8a49-ebfc16dd3923"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.121281    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-certs" pod "05a26d33-eb54-483f-8a0f-0951bbeda3db" (UID: "05a26d33-eb54-483f-8a0f-0951bbeda3db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.121315    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-credential-socket" pod "95080aaa-0f44-42ea-aa2a-1ccddabbdce5" (UID: "95080aaa-0f44-42ea-aa2a-1ccddabbdce5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.121323    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istiod-ca-cert" pod "95080aaa-0f44-42ea-aa2a-1ccddabbdce5" (UID: "95080aaa-0f44-42ea-aa2a-1ccddabbdce5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:04.121757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.121634    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-credential-socket" pod "f5644e6e-0ed6-41af-8a49-ebfc16dd3923" (UID: "f5644e6e-0ed6-41af-8a49-ebfc16dd3923"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.122580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.121810    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-data" pod "95080aaa-0f44-42ea-aa2a-1ccddabbdce5" (UID: "95080aaa-0f44-42ea-aa2a-1ccddabbdce5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.123359 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.123317    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-token" pod "f5644e6e-0ed6-41af-8a49-ebfc16dd3923" (UID: "f5644e6e-0ed6-41af-8a49-ebfc16dd3923"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:04.123479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.123365    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-token" pod "95080aaa-0f44-42ea-aa2a-1ccddabbdce5" (UID: "95080aaa-0f44-42ea-aa2a-1ccddabbdce5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:04.123539 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.123474    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-envoy" pod "95080aaa-0f44-42ea-aa2a-1ccddabbdce5" (UID: "95080aaa-0f44-42ea-aa2a-1ccddabbdce5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.124143 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.124117    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-envoy" pod "05a26d33-eb54-483f-8a0f-0951bbeda3db" (UID: "05a26d33-eb54-483f-8a0f-0951bbeda3db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:04.124591 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.124557    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-kube-api-access-q2clq" pod "95080aaa-0f44-42ea-aa2a-1ccddabbdce5" (UID: "95080aaa-0f44-42ea-aa2a-1ccddabbdce5"). InnerVolumeSpecName "kube-api-access-q2clq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:04.124687 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.124611    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-podinfo" pod "f5644e6e-0ed6-41af-8a49-ebfc16dd3923" (UID: "f5644e6e-0ed6-41af-8a49-ebfc16dd3923"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:04.124850 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.124818    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-kube-api-access-s96cw" pod "05a26d33-eb54-483f-8a0f-0951bbeda3db" (UID: "05a26d33-eb54-483f-8a0f-0951bbeda3db"). InnerVolumeSpecName "kube-api-access-s96cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:04.125110 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.125088    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-token" pod "05a26d33-eb54-483f-8a0f-0951bbeda3db" (UID: "05a26d33-eb54-483f-8a0f-0951bbeda3db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:04.125110 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.125097    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-podinfo" pod "95080aaa-0f44-42ea-aa2a-1ccddabbdce5" (UID: "95080aaa-0f44-42ea-aa2a-1ccddabbdce5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:04.125251 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.125181    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-kube-api-access-m4ssk" pod "f5644e6e-0ed6-41af-8a49-ebfc16dd3923" (UID: "f5644e6e-0ed6-41af-8a49-ebfc16dd3923"). InnerVolumeSpecName "kube-api-access-m4ssk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:04.125752 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.125735    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-podinfo" pod "05a26d33-eb54-483f-8a0f-0951bbeda3db" (UID: "05a26d33-eb54-483f-8a0f-0951bbeda3db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:04.221631 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221597    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4ssk\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-kube-api-access-m4ssk\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221631 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221631    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221658    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2clq\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-kube-api-access-q2clq\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221672    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221685    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221698    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221712    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s96cw\" (UniqueName: \"kubernetes.io/projected/05a26d33-eb54-483f-8a0f-0951bbeda3db-kube-api-access-s96cw\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221730    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221744    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221760    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221774    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221788    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221804    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221818    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221833    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.221854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221849    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.222306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221864    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.222306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221880    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.222306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221893    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.222306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221906    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.222306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221921    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a26d33-eb54-483f-8a0f-0951bbeda3db-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.222306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.221933    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5644e6e-0ed6-41af-8a49-ebfc16dd3923-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.222306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.222011    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.222306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.222021    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95080aaa-0f44-42ea-aa2a-1ccddabbdce5-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:04.490911 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.490881    5575 generic.go:356] "Generic (PLEG): container finished" podID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerID="432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943" exitCode=0
Oct 30 22:11:04.491133 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.490930    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"
Oct 30 22:11:04.491133 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.490955    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" event={"ID":"f5644e6e-0ed6-41af-8a49-ebfc16dd3923","Type":"ContainerDied","Data":"432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943"}
Oct 30 22:11:04.491133 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.491031    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d" event={"ID":"f5644e6e-0ed6-41af-8a49-ebfc16dd3923","Type":"ContainerDied","Data":"67f0ecddf69847a3c7c119d6ca47d20bcb82f6e540b42ffb2b370af262103ff7"}
Oct 30 22:11:04.491133 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.491062    5575 scope.go:122] "RemoveContainer" containerID="432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943"
Oct 30 22:11:04.493040 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.492788    5575 generic.go:356] "Generic (PLEG): container finished" podID="112686fc-ba64-40ff-8206-45381e35c8bc" containerID="d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece" exitCode=0
Oct 30 22:11:04.493040 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.492838    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"
Oct 30 22:11:04.493040 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.492876    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" event={"ID":"112686fc-ba64-40ff-8206-45381e35c8bc","Type":"ContainerDied","Data":"d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece"}
Oct 30 22:11:04.493040 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.492932    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr" event={"ID":"112686fc-ba64-40ff-8206-45381e35c8bc","Type":"ContainerDied","Data":"dbcf55d1933a1fee6874e158aa640193979dfcba7623162148a6da0ae07a58ce"}
Oct 30 22:11:04.494607 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.494586    5575 generic.go:356] "Generic (PLEG): container finished" podID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerID="4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271" exitCode=0
Oct 30 22:11:04.494728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.494636    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"
Oct 30 22:11:04.494728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.494682    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" event={"ID":"95080aaa-0f44-42ea-aa2a-1ccddabbdce5","Type":"ContainerDied","Data":"4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271"}
Oct 30 22:11:04.494824 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.494731    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768" event={"ID":"95080aaa-0f44-42ea-aa2a-1ccddabbdce5","Type":"ContainerDied","Data":"6d0288a5d4c0e6893cccbccbd0f8293bd2af3402b01abcde60c4218689c2a53b"}
Oct 30 22:11:04.496315 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.496293    5575 generic.go:356] "Generic (PLEG): container finished" podID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerID="23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2" exitCode=0
Oct 30 22:11:04.496442 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.496330    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"
Oct 30 22:11:04.496442 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.496409    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" event={"ID":"05a26d33-eb54-483f-8a0f-0951bbeda3db","Type":"ContainerDied","Data":"23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2"}
Oct 30 22:11:04.496573 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.496442    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65" event={"ID":"05a26d33-eb54-483f-8a0f-0951bbeda3db","Type":"ContainerDied","Data":"7b486ae9d2e35e61c1d735b40a30342cae87e1dcbace463102169c8998811eb3"}
Oct 30 22:11:04.506274 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.506221    5575 scope.go:122] "RemoveContainer" containerID="432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943"
Oct 30 22:11:04.506816 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:04.506795    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943\": container with ID starting with 432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943 not found: ID does not exist" containerID="432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943"
Oct 30 22:11:04.506926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.506831    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943"} err="failed to get container status \"432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943\": rpc error: code = NotFound desc = could not find container \"432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943\": container with ID starting with 432e1463433426a8b56f76df60ac78d853eea7f3658cb68edfc3d5e3346c6943 not found: ID does not exist"
Oct 30 22:11:04.506926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.506853    5575 scope.go:122] "RemoveContainer" containerID="d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece"
Oct 30 22:11:04.518074 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.518055    5575 scope.go:122] "RemoveContainer" containerID="d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece"
Oct 30 22:11:04.518330 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:04.518312    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece\": container with ID starting with d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece not found: ID does not exist" containerID="d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece"
Oct 30 22:11:04.518386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.518337    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece"} err="failed to get container status \"d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece\": rpc error: code = NotFound desc = could not find container \"d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece\": container with ID starting with d3dbe2001039afe0439e03b605db6f04b2647638a9739baf183812dcd2178ece not found: ID does not exist"
Oct 30 22:11:04.518386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.518353    5575 scope.go:122] "RemoveContainer" containerID="4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271"
Oct 30 22:11:04.528864 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.528842    5575 scope.go:122] "RemoveContainer" containerID="4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271"
Oct 30 22:11:04.529226 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:04.529206    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271\": container with ID starting with 4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271 not found: ID does not exist" containerID="4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271"
Oct 30 22:11:04.529312 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.529236    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271"} err="failed to get container status \"4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271\": rpc error: code = NotFound desc = could not find container \"4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271\": container with ID starting with 4961407e4a9c11c9c7851da46e4bae99dbdd8efa9adfc574a9bd9715a62e5271 not found: ID does not exist"
Oct 30 22:11:04.529312 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.529256    5575 scope.go:122] "RemoveContainer" containerID="23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2"
Oct 30 22:11:04.538544 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.538527    5575 scope.go:122] "RemoveContainer" containerID="23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2"
Oct 30 22:11:04.538818 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:04.538798    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2\": container with ID starting with 23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2 not found: ID does not exist" containerID="23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2"
Oct 30 22:11:04.538867 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.538826    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2"} err="failed to get container status \"23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2\": rpc error: code = NotFound desc = could not find container \"23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2\": container with ID starting with 23e83456848cb3e768b1ac19845bf06e60153ee1d876ffcf2bb77dc88a8b8fc2 not found: ID does not exist"
Oct 30 22:11:04.658665 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.658610    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"]
Oct 30 22:11:04.662887 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.662866    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-6jt65"]
Oct 30 22:11:04.775378 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.775312    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"]
Oct 30 22:11:04.780786 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.780760    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4jscr"]
Oct 30 22:11:04.782777 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.782755    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:04.938317 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.938285    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"]
Oct 30 22:11:04.944899 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.944873    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ng58d"]
Oct 30 22:11:04.963080 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:04.963050    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:05.064049 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:05.063982    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"]
Oct 30 22:11:05.066606 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:05.066587    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wp768"]
Oct 30 22:11:05.118579 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:05.118540    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"]
Oct 30 22:11:05.119034 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:05.118893    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerName="istio-proxy" containerID="cri-o://53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9" gracePeriod=30
Oct 30 22:11:05.128588 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:05.128560    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" path="/var/lib/kubelet/pods/05a26d33-eb54-483f-8a0f-0951bbeda3db/volumes"
Oct 30 22:11:05.129387 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:05.129370    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" path="/var/lib/kubelet/pods/112686fc-ba64-40ff-8206-45381e35c8bc/volumes"
Oct 30 22:11:05.130004 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:05.129986    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" path="/var/lib/kubelet/pods/95080aaa-0f44-42ea-aa2a-1ccddabbdce5/volumes"
Oct 30 22:11:05.131121 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:05.131102    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" path="/var/lib/kubelet/pods/f5644e6e-0ed6-41af-8a49-ebfc16dd3923/volumes"
Oct 30 22:11:05.166273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:05.166250    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:06.285194 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.285157    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:06.444673 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.444614    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 22:11:06.517645 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.517610    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"]
Oct 30 22:11:06.517857 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.517833    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq" podUID="80aff7c8-329a-41fd-863f-c952ef6e5ceb" containerName="maas-api" containerID="cri-o://20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f" gracePeriod=30
Oct 30 22:11:06.521046 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.521015    5575 generic.go:356] "Generic (PLEG): container finished" podID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerID="576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1" exitCode=0
Oct 30 22:11:06.521184 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.521102    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"
Oct 30 22:11:06.521184 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.521101    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" event={"ID":"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15","Type":"ContainerDied","Data":"576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1"}
Oct 30 22:11:06.521292 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.521221    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f" event={"ID":"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15","Type":"ContainerDied","Data":"4ec124badfab0bbb32b24ffdbe3d96da514e33e029684b263c7559f30513b35f"}
Oct 30 22:11:06.521292 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.521248    5575 scope.go:122] "RemoveContainer" containerID="576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1"
Oct 30 22:11:06.551189 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551161    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istiod-ca-cert\") pod \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") "
Oct 30 22:11:06.551345 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551232    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-data\") pod \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") "
Oct 30 22:11:06.551345 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551279    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-socket\") pod \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") "
Oct 30 22:11:06.551345 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551309    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-token\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-token\") pod \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") "
Oct 30 22:11:06.551594 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551372    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-podinfo\") pod \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") "
Oct 30 22:11:06.551594 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551462    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-certs\") pod \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") "
Oct 30 22:11:06.551594 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551493    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-credential-socket\") pod \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") "
Oct 30 22:11:06.551594 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551552    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-data" pod "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" (UID: "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:06.552019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551563    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-kube-api-access-wgk56\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-kube-api-access-wgk56\") pod \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") "
Oct 30 22:11:06.552019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551655    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-socket" pod "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" (UID: "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:06.552019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.551681    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istiod-ca-cert" pod "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" (UID: "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:06.552210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.552103    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-envoy\") pod \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\" (UID: \"bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15\") "
Oct 30 22:11:06.556252 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.553383    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.556252 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.553414    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.556252 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.553432    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.556252 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.553761    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-certs" pod "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" (UID: "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:06.556252 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.553941    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-credential-socket" pod "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" (UID: "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:06.556252 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.555714    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-kube-api-access-wgk56" pod "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" (UID: "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15"). InnerVolumeSpecName "kube-api-access-wgk56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:06.557253 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.557221    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-envoy" pod "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" (UID: "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:06.558464 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.558438    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-podinfo" pod "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" (UID: "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:06.558848 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.558824    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-token" pod "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" (UID: "bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:06.600409 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.600374    5575 scope.go:122] "RemoveContainer" containerID="576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1"
Oct 30 22:11:06.600921 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:06.600887    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1\": container with ID starting with 576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1 not found: ID does not exist" containerID="576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1"
Oct 30 22:11:06.601065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.600935    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1"} err="failed to get container status \"576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1\": rpc error: code = NotFound desc = could not find container \"576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1\": container with ID starting with 576e839be88c389fb1b82c119fa542a605b1f307be585528bcc2fa1d4d2c8ad1 not found: ID does not exist"
Oct 30 22:11:06.630872 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.630832    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:06.654539 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.654508    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.654539 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.654537    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.654745 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.654553    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.654745 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.654566    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.654745 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.654578    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.654745 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.654590    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgk56\" (UniqueName: \"kubernetes.io/projected/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15-kube-api-access-wgk56\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.759302 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.759276    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 22:11:06.856516 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.856490    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80aff7c8-329a-41fd-863f-c952ef6e5ceb-kube-api-access-jgvhg\" (UniqueName: \"kubernetes.io/projected/80aff7c8-329a-41fd-863f-c952ef6e5ceb-kube-api-access-jgvhg\") pod \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") "
Oct 30 22:11:06.856641 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.856574    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls\") pod \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") "
Oct 30 22:11:06.856724 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.856711    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80aff7c8-329a-41fd-863f-c952ef6e5ceb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aff7c8-329a-41fd-863f-c952ef6e5ceb-openshift-service-ca\") pod \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") "
Oct 30 22:11:06.856767 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.856743    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-metrics-certs\") pod \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\" (UID: \"80aff7c8-329a-41fd-863f-c952ef6e5ceb\") "
Oct 30 22:11:06.857161 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.857133    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80aff7c8-329a-41fd-863f-c952ef6e5ceb-openshift-service-ca" pod "80aff7c8-329a-41fd-863f-c952ef6e5ceb" (UID: "80aff7c8-329a-41fd-863f-c952ef6e5ceb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:06.859209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.859181    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-metrics-certs" pod "80aff7c8-329a-41fd-863f-c952ef6e5ceb" (UID: "80aff7c8-329a-41fd-863f-c952ef6e5ceb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:11:06.859357 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.859331    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80aff7c8-329a-41fd-863f-c952ef6e5ceb-kube-api-access-jgvhg" pod "80aff7c8-329a-41fd-863f-c952ef6e5ceb" (UID: "80aff7c8-329a-41fd-863f-c952ef6e5ceb"). InnerVolumeSpecName "kube-api-access-jgvhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:06.859460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.859388    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls" pod "80aff7c8-329a-41fd-863f-c952ef6e5ceb" (UID: "80aff7c8-329a-41fd-863f-c952ef6e5ceb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:11:06.958408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.958362    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aff7c8-329a-41fd-863f-c952ef6e5ceb-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.958408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.958407    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.958722 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.958424    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgvhg\" (UniqueName: \"kubernetes.io/projected/80aff7c8-329a-41fd-863f-c952ef6e5ceb-kube-api-access-jgvhg\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.958722 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.958441    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80aff7c8-329a-41fd-863f-c952ef6e5ceb-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:06.991687 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.991651    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"]
Oct 30 22:11:06.996312 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:06.996288    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-691598-openshift-default-c4b45464f-gfd2f"]
Oct 30 22:11:07.126060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.125990    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" path="/var/lib/kubelet/pods/bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15/volumes"
Oct 30 22:11:07.529886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.529827    5575 generic.go:356] "Generic (PLEG): container finished" podID="80aff7c8-329a-41fd-863f-c952ef6e5ceb" containerID="20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f" exitCode=0
Oct 30 22:11:07.529886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.529875    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"
Oct 30 22:11:07.530526 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.529911    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq" event={"ID":"80aff7c8-329a-41fd-863f-c952ef6e5ceb","Type":"ContainerDied","Data":"20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f"}
Oct 30 22:11:07.530526 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.529985    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq" event={"ID":"80aff7c8-329a-41fd-863f-c952ef6e5ceb","Type":"ContainerDied","Data":"91f8aaa7a09c603b492195ec1e2a5f3a94596c2966cbd3caeb18ed18f6a7c967"}
Oct 30 22:11:07.530526 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.530011    5575 scope.go:122] "RemoveContainer" containerID="20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f"
Oct 30 22:11:07.540749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.540733    5575 scope.go:122] "RemoveContainer" containerID="20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f"
Oct 30 22:11:07.541002 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:07.540982    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f\": container with ID starting with 20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f not found: ID does not exist" containerID="20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f"
Oct 30 22:11:07.541064 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.541011    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f"} err="failed to get container status \"20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f\": rpc error: code = NotFound desc = could not find container \"20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f\": container with ID starting with 20c0c7451a61f39880338851d0abdc43a97ca199eaf2c84eb0d4f477516c3f8f not found: ID does not exist"
Oct 30 22:11:07.697306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.697271    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"]
Oct 30 22:11:07.703931 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:07.703908    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-6ea374-647484dd5d-457nq"]
Oct 30 22:11:08.341115 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.341085    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:08.540212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.539838    5575 generic.go:356] "Generic (PLEG): container finished" podID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerID="f871fd651ec050c38fb5d03755cb0540004f156a8e6a2f01a2bc9108f406e17a" exitCode=0
Oct 30 22:11:08.540212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.539920    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" event={"ID":"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef","Type":"ContainerDied","Data":"f871fd651ec050c38fb5d03755cb0540004f156a8e6a2f01a2bc9108f406e17a"}
Oct 30 22:11:08.540212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.540007    5575 scope.go:122] "RemoveContainer" containerID="ab67a402c473308a79f5e91689250b03fd28b13d2fd45c9a21e9a0148ac888de"
Oct 30 22:11:08.566834 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.566818    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 22:11:08.605637 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.605604    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:08.677398 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677375    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istiod-ca-cert\") pod \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") "
Oct 30 22:11:08.677510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677418    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-podinfo\") pod \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") "
Oct 30 22:11:08.677510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677474    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-certs\") pod \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") "
Oct 30 22:11:08.677609 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677511    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-token\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-token\") pod \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") "
Oct 30 22:11:08.677609 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677574    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-credential-socket\") pod \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") "
Oct 30 22:11:08.677609 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677604    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-envoy\") pod \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") "
Oct 30 22:11:08.677752 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677731    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-socket\") pod \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") "
Oct 30 22:11:08.677814 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677769    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-kube-api-access-5k8kx\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-kube-api-access-5k8kx\") pod \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") "
Oct 30 22:11:08.677814 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677800    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-certs" pod "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" (UID: "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:08.677927 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677805    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-data\") pod \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\" (UID: \"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef\") "
Oct 30 22:11:08.677927 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.677831    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-credential-socket" pod "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" (UID: "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:08.678160 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.678133    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-socket" pod "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" (UID: "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:08.678244 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.678143    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istiod-ca-cert" pod "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" (UID: "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:08.678404 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.678351    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:08.678404 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.678386    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:08.678404 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.678400    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:08.678404 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.678413    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:08.678404 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.678354    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-data" pod "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" (UID: "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:08.679863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.679840    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-podinfo" pod "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" (UID: "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:08.679979 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.679928    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-envoy" pod "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" (UID: "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:08.680158 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.680135    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-token" pod "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" (UID: "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:08.680254 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.680232    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-kube-api-access-5k8kx" pod "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" (UID: "538d4aa7-ce5c-4ef5-a393-6e89a9d939ef"). InnerVolumeSpecName "kube-api-access-5k8kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:08.766518 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.766486    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:08.779629 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.779608    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:08.779629 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.779631    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:08.779779 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.779640    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:08.779779 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.779650    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:08.779779 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:08.779664    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k8kx\" (UniqueName: \"kubernetes.io/projected/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef-kube-api-access-5k8kx\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:09.133662 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:09.133615    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80aff7c8-329a-41fd-863f-c952ef6e5ceb" path="/var/lib/kubelet/pods/80aff7c8-329a-41fd-863f-c952ef6e5ceb/volumes"
Oct 30 22:11:09.334623 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:09.334586    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:09.550351 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:09.550278    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"
Oct 30 22:11:09.550351 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:09.550290    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv" event={"ID":"538d4aa7-ce5c-4ef5-a393-6e89a9d939ef","Type":"ContainerDied","Data":"1c59eef993810de23daf97d8068e4c029bdfd8332c29e4968c652d068b940129"}
Oct 30 22:11:09.550351 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:09.550348    5575 scope.go:122] "RemoveContainer" containerID="f871fd651ec050c38fb5d03755cb0540004f156a8e6a2f01a2bc9108f406e17a"
Oct 30 22:11:09.830486 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:09.830410    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"]
Oct 30 22:11:09.834847 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:09.834824    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-fd2a94-openshift-default-7bd4bf7c5f-v26vv"]
Oct 30 22:11:10.409161 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.409134    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 22:11:10.496287 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496258    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-credential-socket\") pod \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") "
Oct 30 22:11:10.496444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496297    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-certs\") pod \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") "
Oct 30 22:11:10.496444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496332    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-podinfo\") pod \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") "
Oct 30 22:11:10.496444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496362    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-data\") pod \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") "
Oct 30 22:11:10.496444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496384    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-socket\") pod \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") "
Oct 30 22:11:10.496444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496404    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-token\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-token\") pod \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") "
Oct 30 22:11:10.496742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496459    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-envoy\") pod \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") "
Oct 30 22:11:10.496742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496518    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-kube-api-access-tvbkv\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-kube-api-access-tvbkv\") pod \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") "
Oct 30 22:11:10.496742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496539    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-credential-socket" pod "7512fc0d-f93b-4922-9a51-e7d86db87ba7" (UID: "7512fc0d-f93b-4922-9a51-e7d86db87ba7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:10.496742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496551    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istiod-ca-cert\") pod \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\" (UID: \"7512fc0d-f93b-4922-9a51-e7d86db87ba7\") "
Oct 30 22:11:10.496742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496668    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-data" pod "7512fc0d-f93b-4922-9a51-e7d86db87ba7" (UID: "7512fc0d-f93b-4922-9a51-e7d86db87ba7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:10.496742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496682    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-certs" pod "7512fc0d-f93b-4922-9a51-e7d86db87ba7" (UID: "7512fc0d-f93b-4922-9a51-e7d86db87ba7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:10.496742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.496703    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-socket" pod "7512fc0d-f93b-4922-9a51-e7d86db87ba7" (UID: "7512fc0d-f93b-4922-9a51-e7d86db87ba7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:10.497146 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.497079    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istiod-ca-cert" pod "7512fc0d-f93b-4922-9a51-e7d86db87ba7" (UID: "7512fc0d-f93b-4922-9a51-e7d86db87ba7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:10.497435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.497170    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:10.497435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.497212    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:10.497435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.497279    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:10.497435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.497302    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:10.498759 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.498731    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-podinfo" pod "7512fc0d-f93b-4922-9a51-e7d86db87ba7" (UID: "7512fc0d-f93b-4922-9a51-e7d86db87ba7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:10.498874 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.498840    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-token" pod "7512fc0d-f93b-4922-9a51-e7d86db87ba7" (UID: "7512fc0d-f93b-4922-9a51-e7d86db87ba7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:10.499223 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.499204    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-envoy" pod "7512fc0d-f93b-4922-9a51-e7d86db87ba7" (UID: "7512fc0d-f93b-4922-9a51-e7d86db87ba7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:10.499296 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.499246    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-kube-api-access-tvbkv" pod "7512fc0d-f93b-4922-9a51-e7d86db87ba7" (UID: "7512fc0d-f93b-4922-9a51-e7d86db87ba7"). InnerVolumeSpecName "kube-api-access-tvbkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:10.562039 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.562005    5575 generic.go:356] "Generic (PLEG): container finished" podID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerID="53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9" exitCode=0
Oct 30 22:11:10.562466 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.562045    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" event={"ID":"7512fc0d-f93b-4922-9a51-e7d86db87ba7","Type":"ContainerDied","Data":"53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9"}
Oct 30 22:11:10.562466 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.562075    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"
Oct 30 22:11:10.562466 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.562107    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb" event={"ID":"7512fc0d-f93b-4922-9a51-e7d86db87ba7","Type":"ContainerDied","Data":"dcd0b9ccde217ed6effe0166988b45a996f4d480fade1e585bdf8f7923b15d30"}
Oct 30 22:11:10.562466 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.562131    5575 scope.go:122] "RemoveContainer" containerID="53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9"
Oct 30 22:11:10.574330 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.574311    5575 scope.go:122] "RemoveContainer" containerID="53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9"
Oct 30 22:11:10.574602 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:10.574586    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9\": container with ID starting with 53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9 not found: ID does not exist" containerID="53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9"
Oct 30 22:11:10.574646 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.574611    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9"} err="failed to get container status \"53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9\": rpc error: code = NotFound desc = could not find container \"53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9\": container with ID starting with 53b6e7b9b8c45a3b2d955501e87983c68a134a2393b4cc7ae772e0d2c5c113c9 not found: ID does not exist"
Oct 30 22:11:10.597862 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.597841    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:10.597936 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.597879    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:10.597936 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.597890    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvbkv\" (UniqueName: \"kubernetes.io/projected/7512fc0d-f93b-4922-9a51-e7d86db87ba7-kube-api-access-tvbkv\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:10.597936 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.597899    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:10.597936 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.597908    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7512fc0d-f93b-4922-9a51-e7d86db87ba7-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:10.730023 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.729929    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"]
Oct 30 22:11:10.735977 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:10.735940    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1de75a-openshift-default-5dfc4949f5-w4hgb"]
Oct 30 22:11:11.126697 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:11.126625    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" path="/var/lib/kubelet/pods/538d4aa7-ce5c-4ef5-a393-6e89a9d939ef/volumes"
Oct 30 22:11:11.127297 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:11.127278    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" path="/var/lib/kubelet/pods/7512fc0d-f93b-4922-9a51-e7d86db87ba7/volumes"
Oct 30 22:11:13.908860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:13.908803    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:15.928603 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:15.928570    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"]
Oct 30 22:11:16.134561 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:16.134532    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:16.296691 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:16.296579    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:16.464342 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:16.464308    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:16.724106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:16.724072    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:18.869698 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:18.869667    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:20.929635 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:20.929589    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm" podUID="3b5bf0cd-0842-4ee6-afd7-61983326f113" containerName="payload-processing" containerID="cri-o://e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde" gracePeriod=25
Oct 30 22:11:21.023125 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:21.023084    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:21.180763 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:21.180673    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:22.396073 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:22.396034    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm" podUID="3b5bf0cd-0842-4ee6-afd7-61983326f113" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:11:23.486513 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:23.486472    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:11:23.771093 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:23.770955    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:26.866001 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:26.865950    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:28.966827 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:28.966794    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:32.396402 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:32.396369    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm" podUID="3b5bf0cd-0842-4ee6-afd7-61983326f113" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:11:33.235819 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:33.235788    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:34.901198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:34.901151    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:35.084623 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:35.084591    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:35.270850 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:35.270765    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:35.801576 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:35.801545    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:40.179631 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:40.179593    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:41.196548 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.196492    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:11:41.309803 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.309772    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b5bf0cd-0842-4ee6-afd7-61983326f113-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5bf0cd-0842-4ee6-afd7-61983326f113-plugins-config-volume\") pod \"3b5bf0cd-0842-4ee6-afd7-61983326f113\" (UID: \"3b5bf0cd-0842-4ee6-afd7-61983326f113\") "
Oct 30 22:11:41.309979 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.309867    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b5bf0cd-0842-4ee6-afd7-61983326f113-kube-api-access-c9r5l\" (UniqueName: \"kubernetes.io/projected/3b5bf0cd-0842-4ee6-afd7-61983326f113-kube-api-access-c9r5l\") pod \"3b5bf0cd-0842-4ee6-afd7-61983326f113\" (UID: \"3b5bf0cd-0842-4ee6-afd7-61983326f113\") "
Oct 30 22:11:41.310180 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.310156    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b5bf0cd-0842-4ee6-afd7-61983326f113-plugins-config-volume" pod "3b5bf0cd-0842-4ee6-afd7-61983326f113" (UID: "3b5bf0cd-0842-4ee6-afd7-61983326f113"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:41.310323 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.310307    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5bf0cd-0842-4ee6-afd7-61983326f113-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:41.312156 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.312124    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5bf0cd-0842-4ee6-afd7-61983326f113-kube-api-access-c9r5l" pod "3b5bf0cd-0842-4ee6-afd7-61983326f113" (UID: "3b5bf0cd-0842-4ee6-afd7-61983326f113"). InnerVolumeSpecName "kube-api-access-c9r5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:41.411613 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.411580    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9r5l\" (UniqueName: \"kubernetes.io/projected/3b5bf0cd-0842-4ee6-afd7-61983326f113-kube-api-access-c9r5l\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:41.766133 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.766087    5575 generic.go:356] "Generic (PLEG): container finished" podID="3b5bf0cd-0842-4ee6-afd7-61983326f113" containerID="e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde" exitCode=0
Oct 30 22:11:41.766308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.766156    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"
Oct 30 22:11:41.766308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.766156    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm" event={"ID":"3b5bf0cd-0842-4ee6-afd7-61983326f113","Type":"ContainerDied","Data":"e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde"}
Oct 30 22:11:41.766308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.766233    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm" event={"ID":"3b5bf0cd-0842-4ee6-afd7-61983326f113","Type":"ContainerDied","Data":"50088ad334a5e4c4dc501cd86e34101eeb43fe92b8ba7738f1ac850e9023cd74"}
Oct 30 22:11:41.766308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.766256    5575 scope.go:122] "RemoveContainer" containerID="e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde"
Oct 30 22:11:41.776893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.776875    5575 scope.go:122] "RemoveContainer" containerID="e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde"
Oct 30 22:11:41.777184 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:41.777157    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde\": container with ID starting with e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde not found: ID does not exist" containerID="e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde"
Oct 30 22:11:41.777259 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.777193    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde"} err="failed to get container status \"e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde\": rpc error: code = NotFound desc = could not find container \"e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde\": container with ID starting with e7fa73029dccdbceb99b2043432cedfeada172bb7bb17e2b6e90aefd29176bde not found: ID does not exist"
Oct 30 22:11:41.932775 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.932745    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"]
Oct 30 22:11:41.982756 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:41.982730    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ea1f0b-76b9fcc8dd-w4rmm"]
Oct 30 22:11:42.179842 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:42.179805    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:42.365621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:42.365585    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:42.737568 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:42.737531    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:43.127323 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:43.127253    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b5bf0cd-0842-4ee6-afd7-61983326f113" path="/var/lib/kubelet/pods/3b5bf0cd-0842-4ee6-afd7-61983326f113/volumes"
Oct 30 22:11:43.183670 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:43.183635    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:45.391444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:45.391391    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:48.072892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:48.072857    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"]
Oct 30 22:11:48.123037 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:48.123005    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"]
Oct 30 22:11:48.259746 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:48.259718    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:50.729955 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:50.729917    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:53.486091 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:11:53.486050    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:11:55.223838 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:55.223805    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"]
Oct 30 22:11:55.329311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:55.329249    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"]
Oct 30 22:11:55.614676 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:55.614572    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:55.914429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:55.914386    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:56.169230 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:56.169144    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:57.031853 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:57.031814    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:57.795741 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:57.795684    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:58.729220 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:58.729183    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"]
Oct 30 22:11:58.811236 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:11:58.811199    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:00.224905 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:00.224862    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6" podUID="4640d4b0-8d38-43a1-8be8-085fb6384972" containerName="payload-processing" containerID="cri-o://0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e" gracePeriod=25
Oct 30 22:12:00.330250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:00.330167    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97" podUID="feee97c2-4c34-47a5-a42b-92c0d86fd649" containerName="payload-pre-processing" containerID="cri-o://a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9" gracePeriod=25
Oct 30 22:12:01.206019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:01.205959    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:02.359444 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:02.359406    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97" podUID="feee97c2-4c34-47a5-a42b-92c0d86fd649" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:12:02.359818 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:02.359407    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6" podUID="4640d4b0-8d38-43a1-8be8-085fb6384972" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:12:03.094148 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.094100    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" containerID="cri-o://9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee" gracePeriod=45
Oct 30 22:12:03.143005 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.142938    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main" containerID="cri-o://1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288" gracePeriod=45
Oct 30 22:12:03.246578 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.246530    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": dial tcp 10.132.0.89:8000: connect: connection refused"
Oct 30 22:12:03.422304 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.422277    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 22:12:03.453994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.453944    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 22:12:03.535000 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.534936    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tmp-dir\") pod \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") "
Oct 30 22:12:03.535172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535024    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4342e3b8-2517-4bb3-88d9-37b5baca971b-kube-api-access-xw4sb\" (UniqueName: \"kubernetes.io/projected/4342e3b8-2517-4bb3-88d9-37b5baca971b-kube-api-access-xw4sb\") pod \"4342e3b8-2517-4bb3-88d9-37b5baca971b\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") "
Oct 30 22:12:03.535172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535077    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-kube-api-access-4vxkq\" (UniqueName: \"kubernetes.io/projected/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-kube-api-access-4vxkq\") pod \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") "
Oct 30 22:12:03.535172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535113    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-home\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-home\") pod \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") "
Oct 30 22:12:03.535172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535162    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-model-cache\") pod \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") "
Oct 30 22:12:03.535346 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535199    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tls-certs\" (UniqueName: \"kubernetes.io/secret/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tls-certs\") pod \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") "
Oct 30 22:12:03.535346 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535243    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tmp-dir" pod "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" (UID: "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:03.535346 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535255    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-dshm\") pod \"4342e3b8-2517-4bb3-88d9-37b5baca971b\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") "
Oct 30 22:12:03.535346 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535328    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4342e3b8-2517-4bb3-88d9-37b5baca971b-tls-certs\" (UniqueName: \"kubernetes.io/secret/4342e3b8-2517-4bb3-88d9-37b5baca971b-tls-certs\") pod \"4342e3b8-2517-4bb3-88d9-37b5baca971b\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") "
Oct 30 22:12:03.535483 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535362    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-home\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-home\") pod \"4342e3b8-2517-4bb3-88d9-37b5baca971b\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") "
Oct 30 22:12:03.535483 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535391    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-dshm\") pod \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\" (UID: \"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36\") "
Oct 30 22:12:03.535483 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535450    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-model-cache\") pod \"4342e3b8-2517-4bb3-88d9-37b5baca971b\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") "
Oct 30 22:12:03.535637 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535567    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-tmp-dir\") pod \"4342e3b8-2517-4bb3-88d9-37b5baca971b\" (UID: \"4342e3b8-2517-4bb3-88d9-37b5baca971b\") "
Oct 30 22:12:03.535764 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535740    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-home" pod "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" (UID: "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:03.535958 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.535937    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-tmp-dir" pod "4342e3b8-2517-4bb3-88d9-37b5baca971b" (UID: "4342e3b8-2517-4bb3-88d9-37b5baca971b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:03.536128 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.536110    5575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-tmp-dir\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.536191 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.536134    5575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tmp-dir\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.536191 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.536146    5575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-home\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.537433 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.537401    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-model-cache" pod "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" (UID: "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:03.537555 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.537451    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-model-cache" pod "4342e3b8-2517-4bb3-88d9-37b5baca971b" (UID: "4342e3b8-2517-4bb3-88d9-37b5baca971b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:03.537726 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.537704    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-home" pod "4342e3b8-2517-4bb3-88d9-37b5baca971b" (UID: "4342e3b8-2517-4bb3-88d9-37b5baca971b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:03.538106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.538080    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-dshm" pod "4342e3b8-2517-4bb3-88d9-37b5baca971b" (UID: "4342e3b8-2517-4bb3-88d9-37b5baca971b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:03.539172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.539142    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4342e3b8-2517-4bb3-88d9-37b5baca971b-tls-certs" pod "4342e3b8-2517-4bb3-88d9-37b5baca971b" (UID: "4342e3b8-2517-4bb3-88d9-37b5baca971b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:12:03.539440 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.539422    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-dshm" pod "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" (UID: "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:03.539775 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.539747    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4342e3b8-2517-4bb3-88d9-37b5baca971b-kube-api-access-xw4sb" pod "4342e3b8-2517-4bb3-88d9-37b5baca971b" (UID: "4342e3b8-2517-4bb3-88d9-37b5baca971b"). InnerVolumeSpecName "kube-api-access-xw4sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:03.539909 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.539892    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tls-certs" pod "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" (UID: "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:12:03.540138 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.540112    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-kube-api-access-4vxkq" pod "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" (UID: "07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36"). InnerVolumeSpecName "kube-api-access-4vxkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:03.637212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.637180    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw4sb\" (UniqueName: \"kubernetes.io/projected/4342e3b8-2517-4bb3-88d9-37b5baca971b-kube-api-access-xw4sb\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.637212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.637208    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vxkq\" (UniqueName: \"kubernetes.io/projected/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-kube-api-access-4vxkq\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.637212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.637218    5575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-model-cache\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.637447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.637227    5575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-tls-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.637447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.637236    5575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-dshm\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.637447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.637244    5575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4342e3b8-2517-4bb3-88d9-37b5baca971b-tls-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.637447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.637251    5575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-home\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.637447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.637259    5575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36-dshm\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.637447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.637265    5575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4342e3b8-2517-4bb3-88d9-37b5baca971b-model-cache\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:03.906736 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.906647    5575 generic.go:356] "Generic (PLEG): container finished" podID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerID="9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee" exitCode=0
Oct 30 22:12:03.906736 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.906699    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"
Oct 30 22:12:03.906988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.906730    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" event={"ID":"4342e3b8-2517-4bb3-88d9-37b5baca971b","Type":"ContainerDied","Data":"9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee"}
Oct 30 22:12:03.906988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.906779    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7" event={"ID":"4342e3b8-2517-4bb3-88d9-37b5baca971b","Type":"ContainerDied","Data":"5b2c476f344841017f276509b1b51f4e35f8ec0ef6f8ab8aa575035b103da2ec"}
Oct 30 22:12:03.906988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.906801    5575 scope.go:122] "RemoveContainer" containerID="9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee"
Oct 30 22:12:03.908657 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.908630    5575 generic.go:356] "Generic (PLEG): container finished" podID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerID="1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288" exitCode=0
Oct 30 22:12:03.908793 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.908671    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"
Oct 30 22:12:03.908793 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.908673    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" event={"ID":"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36","Type":"ContainerDied","Data":"1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288"}
Oct 30 22:12:03.908793 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.908780    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9" event={"ID":"07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36","Type":"ContainerDied","Data":"51976f30bcfd7713c8ae6554723dcdf195e37d1cf7620a487c4494af12a53554"}
Oct 30 22:12:03.919501 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.919480    5575 scope.go:122] "RemoveContainer" containerID="9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee"
Oct 30 22:12:03.919757 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:12:03.919740    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee\": container with ID starting with 9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee not found: ID does not exist" containerID="9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee"
Oct 30 22:12:03.919810 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.919764    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee"} err="failed to get container status \"9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee\": rpc error: code = NotFound desc = could not find container \"9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee\": container with ID starting with 9520fa2934a11d31d8790b44c4d8a6416c619a6fc0967852676a942b0459c9ee not found: ID does not exist"
Oct 30 22:12:03.919810 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.919781    5575 scope.go:122] "RemoveContainer" containerID="1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288"
Oct 30 22:12:03.929110 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.929094    5575 scope.go:122] "RemoveContainer" containerID="1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288"
Oct 30 22:12:03.929376 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:12:03.929357    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288\": container with ID starting with 1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288 not found: ID does not exist" containerID="1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288"
Oct 30 22:12:03.929427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:03.929383    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288"} err="failed to get container status \"1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288\": rpc error: code = NotFound desc = could not find container \"1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288\": container with ID starting with 1c6c5e4896344192d53e25412979abaf0011282150ec20e1c363e6d3fcdf9288 not found: ID does not exist"
Oct 30 22:12:04.088149 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:04.088116    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"]
Oct 30 22:12:04.092294 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:04.092264    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/distinct-2-w5-c7d477-kserve-75ddfd77d7-4rcz7"]
Oct 30 22:12:04.210743 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:04.210671    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"]
Oct 30 22:12:04.218267 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:04.218240    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-c7d477/premium-w5-c7d477-kserve-54f958b7df-ldsm9"]
Oct 30 22:12:05.127689 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:05.127631    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" path="/var/lib/kubelet/pods/07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36/volumes"
Oct 30 22:12:05.128239 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:05.128078    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" path="/var/lib/kubelet/pods/4342e3b8-2517-4bb3-88d9-37b5baca971b/volumes"
Oct 30 22:12:06.811554 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:06.811522    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:11.498230 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:11.498194    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:11.870231 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:11.870150    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:12.298147 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:12.298116    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:12.358779 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:12.358745    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6" podUID="4640d4b0-8d38-43a1-8be8-085fb6384972" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:12:12.358779 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:12.358752    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97" podUID="feee97c2-4c34-47a5-a42b-92c0d86fd649" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:12:13.750989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:13.750921    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv" podUID="ce6344e4-4221-4a54-b13b-015a90c1f861" containerName="main" containerID="cri-o://715f4e32d7a4b73d34686a14ad05db7c235968da342608dd02b43d92c2ef7037" gracePeriod=45
Oct 30 22:12:13.981559 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:13.981516    5575 generic.go:356] "Generic (PLEG): container finished" podID="ce6344e4-4221-4a54-b13b-015a90c1f861" containerID="715f4e32d7a4b73d34686a14ad05db7c235968da342608dd02b43d92c2ef7037" exitCode=0
Oct 30 22:12:13.981724 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:13.981598    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv" event={"ID":"ce6344e4-4221-4a54-b13b-015a90c1f861","Type":"ContainerDied","Data":"715f4e32d7a4b73d34686a14ad05db7c235968da342608dd02b43d92c2ef7037"}
Oct 30 22:12:14.016843 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.016783    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:12:14.137028 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.136996    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-model-cache\") pod \"ce6344e4-4221-4a54-b13b-015a90c1f861\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") "
Oct 30 22:12:14.137164 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137068    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-tmp-dir\") pod \"ce6344e4-4221-4a54-b13b-015a90c1f861\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") "
Oct 30 22:12:14.137164 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137113    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce6344e4-4221-4a54-b13b-015a90c1f861-tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6344e4-4221-4a54-b13b-015a90c1f861-tls-certs\") pod \"ce6344e4-4221-4a54-b13b-015a90c1f861\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") "
Oct 30 22:12:14.137243 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137179    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-dshm\") pod \"ce6344e4-4221-4a54-b13b-015a90c1f861\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") "
Oct 30 22:12:14.137243 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137197    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-model-cache" pod "ce6344e4-4221-4a54-b13b-015a90c1f861" (UID: "ce6344e4-4221-4a54-b13b-015a90c1f861"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:14.137243 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137227    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce6344e4-4221-4a54-b13b-015a90c1f861-kube-api-access-rlqgh\" (UniqueName: \"kubernetes.io/projected/ce6344e4-4221-4a54-b13b-015a90c1f861-kube-api-access-rlqgh\") pod \"ce6344e4-4221-4a54-b13b-015a90c1f861\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") "
Oct 30 22:12:14.137343 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137272    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-home\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-home\") pod \"ce6344e4-4221-4a54-b13b-015a90c1f861\" (UID: \"ce6344e4-4221-4a54-b13b-015a90c1f861\") "
Oct 30 22:12:14.137343 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137325    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-tmp-dir" pod "ce6344e4-4221-4a54-b13b-015a90c1f861" (UID: "ce6344e4-4221-4a54-b13b-015a90c1f861"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:14.137681 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137592    5575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-model-cache\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:14.137681 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137601    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-home" pod "ce6344e4-4221-4a54-b13b-015a90c1f861" (UID: "ce6344e4-4221-4a54-b13b-015a90c1f861"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:14.137681 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.137659    5575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-tmp-dir\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:14.139706 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.139682    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6344e4-4221-4a54-b13b-015a90c1f861-kube-api-access-rlqgh" pod "ce6344e4-4221-4a54-b13b-015a90c1f861" (UID: "ce6344e4-4221-4a54-b13b-015a90c1f861"). InnerVolumeSpecName "kube-api-access-rlqgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:14.139874 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.139850    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce6344e4-4221-4a54-b13b-015a90c1f861-tls-certs" pod "ce6344e4-4221-4a54-b13b-015a90c1f861" (UID: "ce6344e4-4221-4a54-b13b-015a90c1f861"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:12:14.139874 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.139855    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-dshm" pod "ce6344e4-4221-4a54-b13b-015a90c1f861" (UID: "ce6344e4-4221-4a54-b13b-015a90c1f861"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:14.238329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.238302    5575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6344e4-4221-4a54-b13b-015a90c1f861-tls-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:14.238329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.238327    5575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-dshm\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:14.238543 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.238338    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlqgh\" (UniqueName: \"kubernetes.io/projected/ce6344e4-4221-4a54-b13b-015a90c1f861-kube-api-access-rlqgh\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:14.238543 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.238349    5575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6344e4-4221-4a54-b13b-015a90c1f861-home\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:14.989942 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.989895    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv" event={"ID":"ce6344e4-4221-4a54-b13b-015a90c1f861","Type":"ContainerDied","Data":"2b903920745181534eec298d529c33a7ab8795464bc682f337cf8b08bc5cc8c0"}
Oct 30 22:12:14.989942 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.989939    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"
Oct 30 22:12:14.990587 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:14.989960    5575 scope.go:122] "RemoveContainer" containerID="715f4e32d7a4b73d34686a14ad05db7c235968da342608dd02b43d92c2ef7037"
Oct 30 22:12:15.157311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:15.157278    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"]
Oct 30 22:12:15.205763 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:15.205734    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-19bc92/test-model-19bc92-kserve-7f874f449f-zdnqv"]
Oct 30 22:12:17.125614 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:17.125582    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce6344e4-4221-4a54-b13b-015a90c1f861" path="/var/lib/kubelet/pods/ce6344e4-4221-4a54-b13b-015a90c1f861/volumes"
Oct 30 22:12:17.183473 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:17.183442    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:20.504734 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.504711    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 22:12:20.597794 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.597770    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4640d4b0-8d38-43a1-8be8-085fb6384972-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4640d4b0-8d38-43a1-8be8-085fb6384972-plugins-config-volume\") pod \"4640d4b0-8d38-43a1-8be8-085fb6384972\" (UID: \"4640d4b0-8d38-43a1-8be8-085fb6384972\") "
Oct 30 22:12:20.597919 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.597878    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4640d4b0-8d38-43a1-8be8-085fb6384972-kube-api-access-rs5bp\" (UniqueName: \"kubernetes.io/projected/4640d4b0-8d38-43a1-8be8-085fb6384972-kube-api-access-rs5bp\") pod \"4640d4b0-8d38-43a1-8be8-085fb6384972\" (UID: \"4640d4b0-8d38-43a1-8be8-085fb6384972\") "
Oct 30 22:12:20.598157 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.598135    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4640d4b0-8d38-43a1-8be8-085fb6384972-plugins-config-volume" pod "4640d4b0-8d38-43a1-8be8-085fb6384972" (UID: "4640d4b0-8d38-43a1-8be8-085fb6384972"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:12:20.599954 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.599935    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4640d4b0-8d38-43a1-8be8-085fb6384972-kube-api-access-rs5bp" pod "4640d4b0-8d38-43a1-8be8-085fb6384972" (UID: "4640d4b0-8d38-43a1-8be8-085fb6384972"). InnerVolumeSpecName "kube-api-access-rs5bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:20.600234 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.600219    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 22:12:20.699470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.699435    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/feee97c2-4c34-47a5-a42b-92c0d86fd649-kube-api-access-bdsrt\" (UniqueName: \"kubernetes.io/projected/feee97c2-4c34-47a5-a42b-92c0d86fd649-kube-api-access-bdsrt\") pod \"feee97c2-4c34-47a5-a42b-92c0d86fd649\" (UID: \"feee97c2-4c34-47a5-a42b-92c0d86fd649\") "
Oct 30 22:12:20.699643 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.699511    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/feee97c2-4c34-47a5-a42b-92c0d86fd649-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feee97c2-4c34-47a5-a42b-92c0d86fd649-plugins-config-volume\") pod \"feee97c2-4c34-47a5-a42b-92c0d86fd649\" (UID: \"feee97c2-4c34-47a5-a42b-92c0d86fd649\") "
Oct 30 22:12:20.699845 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.699818    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4640d4b0-8d38-43a1-8be8-085fb6384972-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:20.699941 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.699853    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs5bp\" (UniqueName: \"kubernetes.io/projected/4640d4b0-8d38-43a1-8be8-085fb6384972-kube-api-access-rs5bp\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:20.700172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.700144    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feee97c2-4c34-47a5-a42b-92c0d86fd649-plugins-config-volume" pod "feee97c2-4c34-47a5-a42b-92c0d86fd649" (UID: "feee97c2-4c34-47a5-a42b-92c0d86fd649"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:12:20.702293 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.702267    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feee97c2-4c34-47a5-a42b-92c0d86fd649-kube-api-access-bdsrt" pod "feee97c2-4c34-47a5-a42b-92c0d86fd649" (UID: "feee97c2-4c34-47a5-a42b-92c0d86fd649"). InnerVolumeSpecName "kube-api-access-bdsrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:20.800482 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.800411    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdsrt\" (UniqueName: \"kubernetes.io/projected/feee97c2-4c34-47a5-a42b-92c0d86fd649-kube-api-access-bdsrt\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:20.800482 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:20.800437    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feee97c2-4c34-47a5-a42b-92c0d86fd649-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:21.029072 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.029035    5575 generic.go:356] "Generic (PLEG): container finished" podID="feee97c2-4c34-47a5-a42b-92c0d86fd649" containerID="a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9" exitCode=0
Oct 30 22:12:21.029072 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.029071    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"
Oct 30 22:12:21.029326 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.029116    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97" event={"ID":"feee97c2-4c34-47a5-a42b-92c0d86fd649","Type":"ContainerDied","Data":"a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9"}
Oct 30 22:12:21.029326 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.029188    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97" event={"ID":"feee97c2-4c34-47a5-a42b-92c0d86fd649","Type":"ContainerDied","Data":"514e57888e4b48c8d8cc1e6acf3f69263e757fbcecee460fe9f6ad629ee4a5fe"}
Oct 30 22:12:21.029326 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.029213    5575 scope.go:122] "RemoveContainer" containerID="a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9"
Oct 30 22:12:21.031125 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.031100    5575 generic.go:356] "Generic (PLEG): container finished" podID="4640d4b0-8d38-43a1-8be8-085fb6384972" containerID="0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e" exitCode=0
Oct 30 22:12:21.031236 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.031149    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6" event={"ID":"4640d4b0-8d38-43a1-8be8-085fb6384972","Type":"ContainerDied","Data":"0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e"}
Oct 30 22:12:21.031236 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.031161    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"
Oct 30 22:12:21.031236 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.031188    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6" event={"ID":"4640d4b0-8d38-43a1-8be8-085fb6384972","Type":"ContainerDied","Data":"d54c426521bfa619282b16f33a0a3db141201c0256a3cbe2d2accea6f1277b71"}
Oct 30 22:12:21.041534 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.041514    5575 scope.go:122] "RemoveContainer" containerID="a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9"
Oct 30 22:12:21.041849 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:12:21.041819    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9\": container with ID starting with a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9 not found: ID does not exist" containerID="a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9"
Oct 30 22:12:21.041938 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.041859    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9"} err="failed to get container status \"a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9\": rpc error: code = NotFound desc = could not find container \"a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9\": container with ID starting with a32404fb5cf6d5ddd1ab86465efbde5cbf9e6c06f04208bee5ab4232ac6635a9 not found: ID does not exist"
Oct 30 22:12:21.041938 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.041883    5575 scope.go:122] "RemoveContainer" containerID="0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e"
Oct 30 22:12:21.053274 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.053255    5575 scope.go:122] "RemoveContainer" containerID="0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e"
Oct 30 22:12:21.053574 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:12:21.053554    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e\": container with ID starting with 0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e not found: ID does not exist" containerID="0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e"
Oct 30 22:12:21.053633 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.053584    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e"} err="failed to get container status \"0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e\": rpc error: code = NotFound desc = could not find container \"0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e\": container with ID starting with 0625cf548c4a6da88968f82c82a3c173ff54ef152ee0ca62ad078d7a968f0c2e not found: ID does not exist"
Oct 30 22:12:21.195808 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.195783    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"]
Oct 30 22:12:21.248527 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.248498    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-c7d477-579f59b6d-hqvq6"]
Oct 30 22:12:21.356938 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.356866    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"]
Oct 30 22:12:21.363381 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.363355    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-c7d477-79cdf6b98c-j5g97"]
Oct 30 22:12:21.479656 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:21.479612    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:23.046565 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:23.046532    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:23.126158 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:23.126127    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4640d4b0-8d38-43a1-8be8-085fb6384972" path="/var/lib/kubelet/pods/4640d4b0-8d38-43a1-8be8-085fb6384972/volumes"
Oct 30 22:12:23.126520 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:23.126499    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="feee97c2-4c34-47a5-a42b-92c0d86fd649" path="/var/lib/kubelet/pods/feee97c2-4c34-47a5-a42b-92c0d86fd649/volumes"
Oct 30 22:12:23.277906 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:23.277872    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:23.435438 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:23.435405    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:23.488016 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:12:23.487980    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:12:24.043380 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:24.043344    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:25.979539 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:25.979508    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:26.553862 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:26.553825    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:26.752675 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:26.752635    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:27.590889 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:27.590859    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:28.038563 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.038526    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"]
Oct 30 22:12:28.038768 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.038741    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs" podUID="eef04870-4eb9-4a6a-b289-a01028fca172" containerName="maas-api" containerID="cri-o://4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a" gracePeriod=30
Oct 30 22:12:28.172113 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.172081    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:28.309950 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.309921    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:12:28.474317 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.474281    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eef04870-4eb9-4a6a-b289-a01028fca172-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef04870-4eb9-4a6a-b289-a01028fca172-openshift-service-ca\") pod \"eef04870-4eb9-4a6a-b289-a01028fca172\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") "
Oct 30 22:12:28.474489 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.474417    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-metrics-certs\") pod \"eef04870-4eb9-4a6a-b289-a01028fca172\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") "
Oct 30 22:12:28.474489 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.474475    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eef04870-4eb9-4a6a-b289-a01028fca172-kube-api-access-tb8ql\" (UniqueName: \"kubernetes.io/projected/eef04870-4eb9-4a6a-b289-a01028fca172-kube-api-access-tb8ql\") pod \"eef04870-4eb9-4a6a-b289-a01028fca172\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") "
Oct 30 22:12:28.474625 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.474595    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls\") pod \"eef04870-4eb9-4a6a-b289-a01028fca172\" (UID: \"eef04870-4eb9-4a6a-b289-a01028fca172\") "
Oct 30 22:12:28.474763 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.474732    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef04870-4eb9-4a6a-b289-a01028fca172-openshift-service-ca" pod "eef04870-4eb9-4a6a-b289-a01028fca172" (UID: "eef04870-4eb9-4a6a-b289-a01028fca172"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:12:28.475157 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.475123    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef04870-4eb9-4a6a-b289-a01028fca172-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:28.477621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.477011    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-metrics-certs" pod "eef04870-4eb9-4a6a-b289-a01028fca172" (UID: "eef04870-4eb9-4a6a-b289-a01028fca172"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:12:28.477621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.477299    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls" pod "eef04870-4eb9-4a6a-b289-a01028fca172" (UID: "eef04870-4eb9-4a6a-b289-a01028fca172"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:12:28.477621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.477356    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef04870-4eb9-4a6a-b289-a01028fca172-kube-api-access-tb8ql" pod "eef04870-4eb9-4a6a-b289-a01028fca172" (UID: "eef04870-4eb9-4a6a-b289-a01028fca172"). InnerVolumeSpecName "kube-api-access-tb8ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:28.576634 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.576549    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:28.576634 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.576578    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb8ql\" (UniqueName: \"kubernetes.io/projected/eef04870-4eb9-4a6a-b289-a01028fca172-kube-api-access-tb8ql\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:28.576634 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:28.576587    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef04870-4eb9-4a6a-b289-a01028fca172-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:29.085298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.085265    5575 generic.go:356] "Generic (PLEG): container finished" podID="eef04870-4eb9-4a6a-b289-a01028fca172" containerID="4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a" exitCode=0
Oct 30 22:12:29.085685 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.085310    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"
Oct 30 22:12:29.085685 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.085359    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs" event={"ID":"eef04870-4eb9-4a6a-b289-a01028fca172","Type":"ContainerDied","Data":"4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a"}
Oct 30 22:12:29.085685 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.085416    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs" event={"ID":"eef04870-4eb9-4a6a-b289-a01028fca172","Type":"ContainerDied","Data":"4187a6fcf6348ba2164ef0a877f77fadfa67e2865c644ca3d58c7d0209857dd1"}
Oct 30 22:12:29.085685 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.085443    5575 scope.go:122] "RemoveContainer" containerID="4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a"
Oct 30 22:12:29.095447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.095428    5575 scope.go:122] "RemoveContainer" containerID="4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a"
Oct 30 22:12:29.095682 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:12:29.095666    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a\": container with ID starting with 4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a not found: ID does not exist" containerID="4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a"
Oct 30 22:12:29.095735 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.095690    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a"} err="failed to get container status \"4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a\": rpc error: code = NotFound desc = could not find container \"4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a\": container with ID starting with 4b1b8997315db8df537013dd464e2fe773dad80e0bf04852e03ba4717881258a not found: ID does not exist"
Oct 30 22:12:29.253749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.253709    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"]
Oct 30 22:12:29.303491 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.303459    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6dcc0-88c6c6565-gbbvs"]
Oct 30 22:12:29.727123 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.727085    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:29.970634 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:29.970605    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:30.136603 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:30.136564    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:30.484466 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:30.484376    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"]
Oct 30 22:12:30.484746 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:30.484688    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy" containerID="cri-o://ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a" gracePeriod=30
Oct 30 22:12:30.486064 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:30.485886    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:30.697796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:30.697737    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:31.126838 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:31.126789    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eef04870-4eb9-4a6a-b289-a01028fca172" path="/var/lib/kubelet/pods/eef04870-4eb9-4a6a-b289-a01028fca172/volumes"
Oct 30 22:12:33.922701 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:33.922666    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:35.273223 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.273188    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:35.743627 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.743603    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 22:12:35.845709 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.845684    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istiod-ca-cert\") pod \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") "
Oct 30 22:12:35.845858 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.845718    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-envoy\") pod \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") "
Oct 30 22:12:35.845940 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.845859    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-certs\") pod \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") "
Oct 30 22:12:35.845940 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.845919    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-data\") pod \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") "
Oct 30 22:12:35.846099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.845958    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-podinfo\") pod \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") "
Oct 30 22:12:35.846099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.846015    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-credential-socket\") pod \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") "
Oct 30 22:12:35.846207 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.846102    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-token\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-token\") pod \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") "
Oct 30 22:12:35.846207 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.846140    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-kube-api-access-pj8rq\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-kube-api-access-pj8rq\") pod \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") "
Oct 30 22:12:35.846207 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.846175    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-socket\") pod \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\" (UID: \"bfc9be4e-8b02-46d5-95d7-717ac210b70e\") "
Oct 30 22:12:35.846650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.846182    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-certs" pod "bfc9be4e-8b02-46d5-95d7-717ac210b70e" (UID: "bfc9be4e-8b02-46d5-95d7-717ac210b70e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:35.846650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.846596    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-socket" pod "bfc9be4e-8b02-46d5-95d7-717ac210b70e" (UID: "bfc9be4e-8b02-46d5-95d7-717ac210b70e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:35.846650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.846209    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istiod-ca-cert" pod "bfc9be4e-8b02-46d5-95d7-717ac210b70e" (UID: "bfc9be4e-8b02-46d5-95d7-717ac210b70e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:12:35.846650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.846246    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-data" pod "bfc9be4e-8b02-46d5-95d7-717ac210b70e" (UID: "bfc9be4e-8b02-46d5-95d7-717ac210b70e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:35.846650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.846438    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-credential-socket" pod "bfc9be4e-8b02-46d5-95d7-717ac210b70e" (UID: "bfc9be4e-8b02-46d5-95d7-717ac210b70e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:35.848364 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.848337    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-kube-api-access-pj8rq" pod "bfc9be4e-8b02-46d5-95d7-717ac210b70e" (UID: "bfc9be4e-8b02-46d5-95d7-717ac210b70e"). InnerVolumeSpecName "kube-api-access-pj8rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:35.848453 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.848386    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-token" pod "bfc9be4e-8b02-46d5-95d7-717ac210b70e" (UID: "bfc9be4e-8b02-46d5-95d7-717ac210b70e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:35.848637 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.848616    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-envoy" pod "bfc9be4e-8b02-46d5-95d7-717ac210b70e" (UID: "bfc9be4e-8b02-46d5-95d7-717ac210b70e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:12:35.848731 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.848633    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-podinfo" pod "bfc9be4e-8b02-46d5-95d7-717ac210b70e" (UID: "bfc9be4e-8b02-46d5-95d7-717ac210b70e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:12:35.947517 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.947486    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:35.947517 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.947511    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:35.947517 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.947521    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj8rq\" (UniqueName: \"kubernetes.io/projected/bfc9be4e-8b02-46d5-95d7-717ac210b70e-kube-api-access-pj8rq\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:35.947724 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.947530    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:35.947724 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.947539    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:35.947724 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.947547    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:35.947724 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.947556    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:35.947724 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.947564    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:35.947724 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:35.947573    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfc9be4e-8b02-46d5-95d7-717ac210b70e-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:36.129785 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:36.129708    5575 generic.go:356] "Generic (PLEG): container finished" podID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerID="ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a" exitCode=0
Oct 30 22:12:36.129785 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:36.129758    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"
Oct 30 22:12:36.129957 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:36.129760    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" event={"ID":"bfc9be4e-8b02-46d5-95d7-717ac210b70e","Type":"ContainerDied","Data":"ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a"}
Oct 30 22:12:36.129957 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:36.129880    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t" event={"ID":"bfc9be4e-8b02-46d5-95d7-717ac210b70e","Type":"ContainerDied","Data":"120b10a31db0b2960a0740d0a67a497392bb3928d005328708ba83bd1b5f8a8b"}
Oct 30 22:12:36.129957 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:36.129905    5575 scope.go:122] "RemoveContainer" containerID="ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a"
Oct 30 22:12:36.141082 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:36.141063    5575 scope.go:122] "RemoveContainer" containerID="ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a"
Oct 30 22:12:36.141336 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:12:36.141318    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a\": container with ID starting with ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a not found: ID does not exist" containerID="ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a"
Oct 30 22:12:36.141401 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:36.141343    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a"} err="failed to get container status \"ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a\": rpc error: code = NotFound desc = could not find container \"ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a\": container with ID starting with ee10989f01c1537533b64f3684bfae3846bf33be9a6345e5b29052080de3a28a not found: ID does not exist"
Oct 30 22:12:36.295744 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:36.295711    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"]
Oct 30 22:12:36.297984 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:36.297951    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-c7d477-openshift-default-776595695-mhz2t"]
Oct 30 22:12:37.126298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:37.126266    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" path="/var/lib/kubelet/pods/bfc9be4e-8b02-46d5-95d7-717ac210b70e/volumes"
Oct 30 22:12:37.144851 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:37.144827    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:37.310452 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:37.310419    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:37.527441 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:37.527410    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:40.284416 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:40.284385    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:45.171312 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:45.171249    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:50.481684 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:50.481648    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:53.487050 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:12:53.487015    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:12:55.815805 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:55.815776    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:58.008742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:12:58.008696    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:00.138285 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.138201    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"]
Oct 30 22:13:00.138758 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.138454    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r" podUID="9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" containerName="maas-api" containerID="cri-o://46e458089f09cfc38b90c8d7ce83a317c6118b34c286fea4182238d15f13e7e8" gracePeriod=30
Oct 30 22:13:00.280250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.280221    5575 generic.go:356] "Generic (PLEG): container finished" podID="9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" containerID="46e458089f09cfc38b90c8d7ce83a317c6118b34c286fea4182238d15f13e7e8" exitCode=0
Oct 30 22:13:00.280400 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.280314    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r" event={"ID":"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0","Type":"ContainerDied","Data":"46e458089f09cfc38b90c8d7ce83a317c6118b34c286fea4182238d15f13e7e8"}
Oct 30 22:13:00.401818 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.401786    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:00.406179 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.406158    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:13:00.478424 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.478401    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-openshift-service-ca\") pod \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") "
Oct 30 22:13:00.478572 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.478475    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-metrics-certs\") pod \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") "
Oct 30 22:13:00.478572 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.478526    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls\") pod \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") "
Oct 30 22:13:00.478572 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.478566    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-kube-api-access-swz5p\" (UniqueName: \"kubernetes.io/projected/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-kube-api-access-swz5p\") pod \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\" (UID: \"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0\") "
Oct 30 22:13:00.478810 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.478781    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-openshift-service-ca" pod "9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" (UID: "9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:00.478935 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.478914    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:00.481327 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.481205    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls" pod "9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" (UID: "9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:00.481327 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.481289    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-metrics-certs" pod "9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" (UID: "9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:00.482828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.482794    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-kube-api-access-swz5p" pod "9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" (UID: "9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0"). InnerVolumeSpecName "kube-api-access-swz5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:00.579873 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.579837    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:00.579873 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.579866    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:00.580094 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.579881    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swz5p\" (UniqueName: \"kubernetes.io/projected/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0-kube-api-access-swz5p\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:00.656754 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:00.656675    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:01.287718 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:01.287684    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"
Oct 30 22:13:01.288179 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:01.287719    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r" event={"ID":"9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0","Type":"ContainerDied","Data":"33a1013906e60107083a401eb7a7b7da96345c387512032ff1a531f0b2f47605"}
Oct 30 22:13:01.288179 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:01.287783    5575 scope.go:122] "RemoveContainer" containerID="46e458089f09cfc38b90c8d7ce83a317c6118b34c286fea4182238d15f13e7e8"
Oct 30 22:13:01.467049 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:01.466951    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"]
Oct 30 22:13:01.516487 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:01.516456    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19bc92-85df79f45c-9jv9r"]
Oct 30 22:13:02.180251 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:02.180213    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:03.125746 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:03.125710    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" path="/var/lib/kubelet/pods/9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0/volumes"
Oct 30 22:13:04.636204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:04.636174    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:04.921722 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:04.921631    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:05.650897 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:05.650859    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:07.431546 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:07.431505    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:11.744201 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:11.744170    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:11.913886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:11.913851    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:12.138719 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:12.138687    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:12.478305 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:12.478223    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:12.652316 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:12.652283    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:12.816212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:12.816132    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:17.691549 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:17.691516    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:17.900184 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:17.900155    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:19.743836 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:19.743812    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:13:19.759350 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:19.759324    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:13:19.772287 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:19.772260    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:13:19.787577 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:19.787557    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:13:22.866264 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:22.866232    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:23.485163 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:13:23.485126    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:13:25.054696 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:25.054656    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:25.212431 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:25.212400    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:27.292399 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292370    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"]
Oct 30 22:13:27.292823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292809    5575 cpu_manager.go:414] "containerMap: removing container" podUID="ce6344e4-4221-4a54-b13b-015a90c1f861" containerName="main"
Oct 30 22:13:27.292886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292824    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce6344e4-4221-4a54-b13b-015a90c1f861" containerName="main"
Oct 30 22:13:27.292886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292847    5575 cpu_manager.go:414] "containerMap: removing container" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy"
Oct 30 22:13:27.292886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292855    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy"
Oct 30 22:13:27.292886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292866    5575 cpu_manager.go:414] "containerMap: removing container" podUID="4640d4b0-8d38-43a1-8be8-085fb6384972" containerName="payload-processing"
Oct 30 22:13:27.292886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292871    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4640d4b0-8d38-43a1-8be8-085fb6384972" containerName="payload-processing"
Oct 30 22:13:27.292886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292880    5575 cpu_manager.go:414] "containerMap: removing container" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292887    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292896    5575 cpu_manager.go:414] "containerMap: removing container" podUID="529fb24b-6b8f-426a-adff-749192f21652" containerName="payload-pre-processing"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292904    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="529fb24b-6b8f-426a-adff-749192f21652" containerName="payload-pre-processing"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292915    5575 cpu_manager.go:414] "containerMap: removing container" podUID="80aff7c8-329a-41fd-863f-c952ef6e5ceb" containerName="maas-api"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292922    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80aff7c8-329a-41fd-863f-c952ef6e5ceb" containerName="maas-api"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292934    5575 cpu_manager.go:414] "containerMap: removing container" podUID="eef04870-4eb9-4a6a-b289-a01028fca172" containerName="maas-api"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292941    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eef04870-4eb9-4a6a-b289-a01028fca172" containerName="maas-api"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292950    5575 cpu_manager.go:414] "containerMap: removing container" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292954    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292960    5575 cpu_manager.go:414] "containerMap: removing container" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292977    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292983    5575 cpu_manager.go:414] "containerMap: removing container" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292987    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.292995    5575 cpu_manager.go:414] "containerMap: removing container" podUID="3b5bf0cd-0842-4ee6-afd7-61983326f113" containerName="payload-processing"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293000    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b5bf0cd-0842-4ee6-afd7-61983326f113" containerName="payload-processing"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293009    5575 cpu_manager.go:414] "containerMap: removing container" podUID="6ce56670-6071-44a1-a588-9fa0f0a34598" containerName="maas-api"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293017    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ce56670-6071-44a1-a588-9fa0f0a34598" containerName="maas-api"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293027    5575 cpu_manager.go:414] "containerMap: removing container" podUID="a3aedb2b-13cd-44ea-bb42-30d2c827aa8b" containerName="payload-processing"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293032    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3aedb2b-13cd-44ea-bb42-30d2c827aa8b" containerName="payload-processing"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293039    5575 cpu_manager.go:414] "containerMap: removing container" podUID="9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" containerName="maas-api"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293043    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" containerName="maas-api"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293050    5575 cpu_manager.go:414] "containerMap: removing container" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293054    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61c0d99c-0998-48b5-9367-ef699d3608c7" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293062    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293066    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293071    5575 cpu_manager.go:414] "containerMap: removing container" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293076    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293081    5575 cpu_manager.go:414] "containerMap: removing container" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293088    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293102    5575 cpu_manager.go:414] "containerMap: removing container" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293107    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293115    5575 cpu_manager.go:414] "containerMap: removing container" podUID="feee97c2-4c34-47a5-a42b-92c0d86fd649" containerName="payload-pre-processing"
Oct 30 22:13:27.293105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293119    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="feee97c2-4c34-47a5-a42b-92c0d86fd649" containerName="payload-pre-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293127    5575 cpu_manager.go:414] "containerMap: removing container" podUID="f30f0a55-5c94-4435-b49b-e3a62b8400db" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293131    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f30f0a55-5c94-4435-b49b-e3a62b8400db" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293138    5575 cpu_manager.go:414] "containerMap: removing container" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293142    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293148    5575 cpu_manager.go:414] "containerMap: removing container" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293152    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293157    5575 cpu_manager.go:414] "containerMap: removing container" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293161    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293173    5575 cpu_manager.go:414] "containerMap: removing container" podUID="49940fb5-e60d-4e3b-a2d9-fa539392a145" containerName="payload-pre-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293181    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49940fb5-e60d-4e3b-a2d9-fa539392a145" containerName="payload-pre-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293192    5575 cpu_manager.go:414] "containerMap: removing container" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293196    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293202    5575 cpu_manager.go:414] "containerMap: removing container" podUID="17ca55b8-7545-4c28-b0c3-97618de3dd3f" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293207    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17ca55b8-7545-4c28-b0c3-97618de3dd3f" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293213    5575 cpu_manager.go:414] "containerMap: removing container" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293217    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293222    5575 cpu_manager.go:414] "containerMap: removing container" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293226    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293232    5575 cpu_manager.go:414] "containerMap: removing container" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293236    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293242    5575 cpu_manager.go:414] "containerMap: removing container" podUID="59e5cb43-78bd-49b5-aabf-fda9c2bdee80" containerName="payload-pre-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293248    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59e5cb43-78bd-49b5-aabf-fda9c2bdee80" containerName="payload-pre-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293264    5575 cpu_manager.go:414] "containerMap: removing container" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293269    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293276    5575 cpu_manager.go:414] "containerMap: removing container" podUID="24f62908-0b2f-4d38-841e-239162d48954" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293280    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24f62908-0b2f-4d38-841e-239162d48954" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293289    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293293    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293298    5575 cpu_manager.go:414] "containerMap: removing container" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293302    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293308    5575 cpu_manager.go:414] "containerMap: removing container" podUID="870682b8-47fa-4b93-8c6a-3aebef115d87" containerName="payload-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293312    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="870682b8-47fa-4b93-8c6a-3aebef115d87" containerName="payload-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293400    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="07e1d95f-9b0f-4a6c-bfeb-9043fddbfd36" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293416    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="bdb9c3bb-ddb2-46b8-8d83-92a576b0aa15" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293426    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="3cc981be-9931-4457-a0e6-17fab076f721" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293432    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b5bf0cd-0842-4ee6-afd7-61983326f113" containerName="payload-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293439    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ce56670-6071-44a1-a588-9fa0f0a34598" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293446    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3aedb2b-13cd-44ea-bb42-30d2c827aa8b" containerName="payload-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293451    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ff8faf9-9e88-4e2f-9189-9ceadfa9a2b0" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293457    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293461    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="690910f5-0d9c-4dab-8de0-1eed27769236" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293467    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d6ef7d2-249f-4d93-af89-15af3a2cebfc" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293472    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="95080aaa-0f44-42ea-aa2a-1ccddabbdce5" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293477    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="feee97c2-4c34-47a5-a42b-92c0d86fd649" containerName="payload-pre-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293482    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="f30f0a55-5c94-4435-b49b-e3a62b8400db" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293489    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="e39a3fa7-4979-4555-ac5a-1ab836e7eb98" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293498    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293506    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293511    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="49940fb5-e60d-4e3b-a2d9-fa539392a145" containerName="payload-pre-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293517    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="4342e3b8-2517-4bb3-88d9-37b5baca971b" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293523    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="17ca55b8-7545-4c28-b0c3-97618de3dd3f" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293527    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="bfc9be4e-8b02-46d5-95d7-717ac210b70e" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293531    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="05a26d33-eb54-483f-8a0f-0951bbeda3db" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293537    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5644e6e-0ed6-41af-8a49-ebfc16dd3923" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293542    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293546    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="59e5cb43-78bd-49b5-aabf-fda9c2bdee80" containerName="payload-pre-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293551    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="7512fc0d-f93b-4922-9a51-e7d86db87ba7" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293556    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293560    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="24f62908-0b2f-4d38-841e-239162d48954" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293566    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="112686fc-ba64-40ff-8206-45381e35c8bc" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293573    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="870682b8-47fa-4b93-8c6a-3aebef115d87" containerName="payload-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293582    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293589    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce6344e4-4221-4a54-b13b-015a90c1f861" containerName="main"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293594    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293600    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="4640d4b0-8d38-43a1-8be8-085fb6384972" containerName="payload-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293607    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="529fb24b-6b8f-426a-adff-749192f21652" containerName="payload-pre-processing"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293612    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="80aff7c8-329a-41fd-863f-c952ef6e5ceb" containerName="maas-api"
Oct 30 22:13:27.294099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.293616    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="eef04870-4eb9-4a6a-b289-a01028fca172" containerName="maas-api"
Oct 30 22:13:27.298136 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.298119    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.324165 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.324139    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqfd4\" (UniqueName: \"kubernetes.io/projected/3b84bff1-6d77-4323-b2ce-f40c7454a08e-kube-api-access-mqfd4\") pod \"maas-api-revoke-sub-023a7645-cwbhd\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.324287 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.324221    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-023a7645-cwbhd\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.324357 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.324295    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-023a7645-cwbhd\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.350478 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.350456    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:13:27.350675 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.350660    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:13:27.403018 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.402960    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"]
Oct 30 22:13:27.425227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.425199    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-023a7645-cwbhd\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.425339 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.425267    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-023a7645-cwbhd\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.425339 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.425310    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqfd4\" (UniqueName: \"kubernetes.io/projected/3b84bff1-6d77-4323-b2ce-f40c7454a08e-kube-api-access-mqfd4\") pod \"maas-api-revoke-sub-023a7645-cwbhd\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.425903 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.425880    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-023a7645-cwbhd\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.427737 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.427716    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-023a7645-cwbhd\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.487136 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.487113    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqfd4\" (UniqueName: \"kubernetes.io/projected/3b84bff1-6d77-4323-b2ce-f40c7454a08e-kube-api-access-mqfd4\") pod \"maas-api-revoke-sub-023a7645-cwbhd\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.611087 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.611013    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:27.988710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:27.988678    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"]
Oct 30 22:13:27.993767 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:13:27.993740    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b84bff1_6d77_4323_b2ce_f40c7454a08e.slice/crio-bc6f3b11be09b7e8c22fba65a42715b5c9117d8a4a33fce182f4116d5b77e67f WatchSource:0}: Error finding container bc6f3b11be09b7e8c22fba65a42715b5c9117d8a4a33fce182f4116d5b77e67f: Status 404 returned error can't find the container with id bc6f3b11be09b7e8c22fba65a42715b5c9117d8a4a33fce182f4116d5b77e67f
Oct 30 22:13:28.449696 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:28.449664    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd" event={"ID":"3b84bff1-6d77-4323-b2ce-f40c7454a08e","Type":"ContainerStarted","Data":"87ac505dbe57fae5a07cf34f96f1c7cc5502db0cb3e41c844800b5a3263b316e"}
Oct 30 22:13:28.450179 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:28.449728    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd" event={"ID":"3b84bff1-6d77-4323-b2ce-f40c7454a08e","Type":"ContainerStarted","Data":"bc6f3b11be09b7e8c22fba65a42715b5c9117d8a4a33fce182f4116d5b77e67f"}
Oct 30 22:13:28.567126 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:28.567031    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd" podStartSLOduration=1.567017448 podStartE2EDuration="1.567017448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:28.565216961 +0000 UTC m=+3009.597065495" watchObservedRunningTime="2026-10-30 22:13:28.567017448 +0000 UTC m=+3009.598865980"
Oct 30 22:13:29.457048 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:29.457015    5575 generic.go:356] "Generic (PLEG): container finished" podID="3b84bff1-6d77-4323-b2ce-f40c7454a08e" containerID="87ac505dbe57fae5a07cf34f96f1c7cc5502db0cb3e41c844800b5a3263b316e" exitCode=0
Oct 30 22:13:29.457455 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:29.457102    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd" event={"ID":"3b84bff1-6d77-4323-b2ce-f40c7454a08e","Type":"ContainerDied","Data":"87ac505dbe57fae5a07cf34f96f1c7cc5502db0cb3e41c844800b5a3263b316e"}
Oct 30 22:13:30.601296 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.601272    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:30.655431 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.655399    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b84bff1-6d77-4323-b2ce-f40c7454a08e-kube-api-access-mqfd4\" (UniqueName: \"kubernetes.io/projected/3b84bff1-6d77-4323-b2ce-f40c7454a08e-kube-api-access-mqfd4\") pod \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") "
Oct 30 22:13:30.655628 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.655530    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-openshift-ca\") pod \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") "
Oct 30 22:13:30.655628 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.655595    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-xks-ca\") pod \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\" (UID: \"3b84bff1-6d77-4323-b2ce-f40c7454a08e\") "
Oct 30 22:13:30.655952 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.655924    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-openshift-ca" pod "3b84bff1-6d77-4323-b2ce-f40c7454a08e" (UID: "3b84bff1-6d77-4323-b2ce-f40c7454a08e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:30.657648 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.657622    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b84bff1-6d77-4323-b2ce-f40c7454a08e-kube-api-access-mqfd4" pod "3b84bff1-6d77-4323-b2ce-f40c7454a08e" (UID: "3b84bff1-6d77-4323-b2ce-f40c7454a08e"). InnerVolumeSpecName "kube-api-access-mqfd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:30.658065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.658044    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-xks-ca" pod "3b84bff1-6d77-4323-b2ce-f40c7454a08e" (UID: "3b84bff1-6d77-4323-b2ce-f40c7454a08e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:30.756403 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.756328    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:30.756403 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.756359    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3b84bff1-6d77-4323-b2ce-f40c7454a08e-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:30.756403 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:30.756372    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqfd4\" (UniqueName: \"kubernetes.io/projected/3b84bff1-6d77-4323-b2ce-f40c7454a08e-kube-api-access-mqfd4\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:31.470758 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:31.470686    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"
Oct 30 22:13:31.470913 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:31.470680    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd" event={"ID":"3b84bff1-6d77-4323-b2ce-f40c7454a08e","Type":"ContainerDied","Data":"bc6f3b11be09b7e8c22fba65a42715b5c9117d8a4a33fce182f4116d5b77e67f"}
Oct 30 22:13:31.470913 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:31.470805    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc6f3b11be09b7e8c22fba65a42715b5c9117d8a4a33fce182f4116d5b77e67f"
Oct 30 22:13:42.527831 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.527787    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"]
Oct 30 22:13:42.528346 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.527993    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56" podUID="7b8d46bd-7815-4c9b-b3bf-a88121558e3a" containerName="maas-api" containerID="cri-o://99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc" gracePeriod=30
Oct 30 22:13:42.703500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.703398    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:42.793241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.793215    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 22:13:42.876142 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.876050    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-metrics-certs\") pod \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") "
Oct 30 22:13:42.876310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.876170    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-kube-api-access-mhl8l\" (UniqueName: \"kubernetes.io/projected/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-kube-api-access-mhl8l\") pod \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") "
Oct 30 22:13:42.876310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.876209    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-openshift-service-ca\") pod \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") "
Oct 30 22:13:42.876310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.876273    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls\") pod \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\" (UID: \"7b8d46bd-7815-4c9b-b3bf-a88121558e3a\") "
Oct 30 22:13:42.876661 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.876628    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-openshift-service-ca" pod "7b8d46bd-7815-4c9b-b3bf-a88121558e3a" (UID: "7b8d46bd-7815-4c9b-b3bf-a88121558e3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:42.878452 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.878426    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-metrics-certs" pod "7b8d46bd-7815-4c9b-b3bf-a88121558e3a" (UID: "7b8d46bd-7815-4c9b-b3bf-a88121558e3a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:42.878595 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.878578    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls" pod "7b8d46bd-7815-4c9b-b3bf-a88121558e3a" (UID: "7b8d46bd-7815-4c9b-b3bf-a88121558e3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:42.878661 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.878634    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-kube-api-access-mhl8l" pod "7b8d46bd-7815-4c9b-b3bf-a88121558e3a" (UID: "7b8d46bd-7815-4c9b-b3bf-a88121558e3a"). InnerVolumeSpecName "kube-api-access-mhl8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:42.977922 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.977886    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:42.977922 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.977912    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhl8l\" (UniqueName: \"kubernetes.io/projected/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-kube-api-access-mhl8l\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:42.977922 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.977924    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:42.977922 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:42.977933    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b8d46bd-7815-4c9b-b3bf-a88121558e3a-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:43.546766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:43.546435    5575 generic.go:356] "Generic (PLEG): container finished" podID="7b8d46bd-7815-4c9b-b3bf-a88121558e3a" containerID="99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc" exitCode=0
Oct 30 22:13:43.546766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:43.546484    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"
Oct 30 22:13:43.546766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:43.546495    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56" event={"ID":"7b8d46bd-7815-4c9b-b3bf-a88121558e3a","Type":"ContainerDied","Data":"99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc"}
Oct 30 22:13:43.546766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:43.546549    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56" event={"ID":"7b8d46bd-7815-4c9b-b3bf-a88121558e3a","Type":"ContainerDied","Data":"04a71edb4232e09fee953de4e12216dcbab25abec269d45c41236de7f8cea88d"}
Oct 30 22:13:43.546766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:43.546578    5575 scope.go:122] "RemoveContainer" containerID="99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc"
Oct 30 22:13:43.563108 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:43.563086    5575 scope.go:122] "RemoveContainer" containerID="99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc"
Oct 30 22:13:43.563540 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:13:43.563510    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc\": container with ID starting with 99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc not found: ID does not exist" containerID="99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc"
Oct 30 22:13:43.563651 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:43.563554    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc"} err="failed to get container status \"99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc\": rpc error: code = NotFound desc = could not find container \"99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc\": container with ID starting with 99a94e8151844226d248191771399a0d339ee04a76e74768ef05fe31ce4560fc not found: ID does not exist"
Oct 30 22:13:43.713002 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:43.712883    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"]
Oct 30 22:13:43.762854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:43.762813    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-69e4b2-5f7797977f-vrt56"]
Oct 30 22:13:44.217251 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:44.217221    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:44.497135 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:44.497065    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:45.125317 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:45.125286    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b8d46bd-7815-4c9b-b3bf-a88121558e3a" path="/var/lib/kubelet/pods/7b8d46bd-7815-4c9b-b3bf-a88121558e3a/volumes"
Oct 30 22:13:45.194497 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:45.194466    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:52.127610 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:52.127574    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:52.323584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:52.323548    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:52.463580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:52.463549    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"]
Oct 30 22:13:52.463789 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:52.463762    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy" containerID="cri-o://136c1bf851fbd5840ad3f3506eefff6f6560f06eab1a0974277b2d2f61082010" gracePeriod=30
Oct 30 22:13:52.491268 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:52.491245    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:53.487303 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:13:53.487267    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:13:54.846317 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:54.846286    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:55.004776 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:55.004744    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:55.277082 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:55.277049    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:57.633021 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.632947    5575 generic.go:356] "Generic (PLEG): container finished" podID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerID="136c1bf851fbd5840ad3f3506eefff6f6560f06eab1a0974277b2d2f61082010" exitCode=0
Oct 30 22:13:57.633021 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.633001    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" event={"ID":"d5c98795-1764-46b9-a95f-c084ef7f32c5","Type":"ContainerDied","Data":"136c1bf851fbd5840ad3f3506eefff6f6560f06eab1a0974277b2d2f61082010"}
Oct 30 22:13:57.633591 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.633075    5575 scope.go:122] "RemoveContainer" containerID="5e65dba98d5b434c6de340ecb4ddd3daf57247afa46ba802e327c9781bd07803"
Oct 30 22:13:57.737397 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.737338    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 22:13:57.914802 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.914765    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-socket\") pod \"d5c98795-1764-46b9-a95f-c084ef7f32c5\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") "
Oct 30 22:13:57.914996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.914844    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-podinfo\") pod \"d5c98795-1764-46b9-a95f-c084ef7f32c5\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") "
Oct 30 22:13:57.914996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.914876    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-token\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-token\") pod \"d5c98795-1764-46b9-a95f-c084ef7f32c5\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") "
Oct 30 22:13:57.914996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.914936    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-kube-api-access-mlz8f\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-kube-api-access-mlz8f\") pod \"d5c98795-1764-46b9-a95f-c084ef7f32c5\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") "
Oct 30 22:13:57.914996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.914959    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d5c98795-1764-46b9-a95f-c084ef7f32c5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c98795-1764-46b9-a95f-c084ef7f32c5-istiod-ca-cert\") pod \"d5c98795-1764-46b9-a95f-c084ef7f32c5\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") "
Oct 30 22:13:57.915194 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.915013    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-certs\") pod \"d5c98795-1764-46b9-a95f-c084ef7f32c5\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") "
Oct 30 22:13:57.915194 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.915125    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-envoy\") pod \"d5c98795-1764-46b9-a95f-c084ef7f32c5\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") "
Oct 30 22:13:57.915194 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.915157    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-credential-socket\") pod \"d5c98795-1764-46b9-a95f-c084ef7f32c5\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") "
Oct 30 22:13:57.915194 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.915184    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-data\") pod \"d5c98795-1764-46b9-a95f-c084ef7f32c5\" (UID: \"d5c98795-1764-46b9-a95f-c084ef7f32c5\") "
Oct 30 22:13:57.915483 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.915454    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-socket" pod "d5c98795-1764-46b9-a95f-c084ef7f32c5" (UID: "d5c98795-1764-46b9-a95f-c084ef7f32c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:57.915581 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.915550    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:57.915739 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.915719    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-certs" pod "d5c98795-1764-46b9-a95f-c084ef7f32c5" (UID: "d5c98795-1764-46b9-a95f-c084ef7f32c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:57.915812 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.915735    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-credential-socket" pod "d5c98795-1764-46b9-a95f-c084ef7f32c5" (UID: "d5c98795-1764-46b9-a95f-c084ef7f32c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:57.915812 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.915757    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-data" pod "d5c98795-1764-46b9-a95f-c084ef7f32c5" (UID: "d5c98795-1764-46b9-a95f-c084ef7f32c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:57.916463 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.916262    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5c98795-1764-46b9-a95f-c084ef7f32c5-istiod-ca-cert" pod "d5c98795-1764-46b9-a95f-c084ef7f32c5" (UID: "d5c98795-1764-46b9-a95f-c084ef7f32c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:57.918238 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.918216    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-kube-api-access-mlz8f" pod "d5c98795-1764-46b9-a95f-c084ef7f32c5" (UID: "d5c98795-1764-46b9-a95f-c084ef7f32c5"). InnerVolumeSpecName "kube-api-access-mlz8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:57.918357 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.918326    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-token" pod "d5c98795-1764-46b9-a95f-c084ef7f32c5" (UID: "d5c98795-1764-46b9-a95f-c084ef7f32c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:57.918495 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.918473    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-podinfo" pod "d5c98795-1764-46b9-a95f-c084ef7f32c5" (UID: "d5c98795-1764-46b9-a95f-c084ef7f32c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:13:57.918652 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:57.918637    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-envoy" pod "d5c98795-1764-46b9-a95f-c084ef7f32c5" (UID: "d5c98795-1764-46b9-a95f-c084ef7f32c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:58.016796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.016706    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:58.016796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.016748    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:58.016796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.016757    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:58.016796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.016766    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:58.016796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.016775    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:58.016796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.016783    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlz8f\" (UniqueName: \"kubernetes.io/projected/d5c98795-1764-46b9-a95f-c084ef7f32c5-kube-api-access-mlz8f\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:58.016796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.016793    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c98795-1764-46b9-a95f-c084ef7f32c5-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:58.016796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.016801    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c98795-1764-46b9-a95f-c084ef7f32c5-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:58.377557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.377474    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:58.642205 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.642175    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"
Oct 30 22:13:58.642692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.642175    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw" event={"ID":"d5c98795-1764-46b9-a95f-c084ef7f32c5","Type":"ContainerDied","Data":"3b3e22d624e8ecbf106a07812b4944359211af8b94c6b40037711ed5e0b29790"}
Oct 30 22:13:58.642692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.642315    5575 scope.go:122] "RemoveContainer" containerID="136c1bf851fbd5840ad3f3506eefff6f6560f06eab1a0974277b2d2f61082010"
Oct 30 22:13:58.809426 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.809395    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"]
Oct 30 22:13:58.814052 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:58.814028    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-69e4b2-openshift-default-5f7bf6748f-kc8nw"]
Oct 30 22:13:59.125206 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:13:59.125122    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" path="/var/lib/kubelet/pods/d5c98795-1764-46b9-a95f-c084ef7f32c5/volumes"
Oct 30 22:14:01.173209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:01.173179    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:23.485461 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:14:23.485429    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:14:28.062534 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:28.062495    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:28.220551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:28.220515    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:30.249855 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.249777    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"]
Oct 30 22:14:30.250267 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250250    5575 cpu_manager.go:414] "containerMap: removing container" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy"
Oct 30 22:14:30.250310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250268    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5391e528-4cac-4c13-9148-e9eb152ed874" containerName="istio-proxy"
Oct 30 22:14:30.250310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250278    5575 cpu_manager.go:414] "containerMap: removing container" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy"
Oct 30 22:14:30.250310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250283    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy"
Oct 30 22:14:30.250310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250302    5575 cpu_manager.go:414] "containerMap: removing container" podUID="7b8d46bd-7815-4c9b-b3bf-a88121558e3a" containerName="maas-api"
Oct 30 22:14:30.250310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250307    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b8d46bd-7815-4c9b-b3bf-a88121558e3a" containerName="maas-api"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250316    5575 cpu_manager.go:414] "containerMap: removing container" podUID="3b84bff1-6d77-4323-b2ce-f40c7454a08e" containerName="revoke-keys"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250320    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b84bff1-6d77-4323-b2ce-f40c7454a08e" containerName="revoke-keys"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250330    5575 cpu_manager.go:414] "containerMap: removing container" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250334    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250345    5575 cpu_manager.go:414] "containerMap: removing container" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250349    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f98a0ba-90a8-4d14-bc04-f8b2fd593bdf" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250359    5575 cpu_manager.go:414] "containerMap: removing container" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250363    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250421    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b84bff1-6d77-4323-b2ce-f40c7454a08e" containerName="revoke-keys"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250428    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250437    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb9f5642-220c-44e0-99be-5151a484e3d3" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250445    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="538d4aa7-ce5c-4ef5-a393-6e89a9d939ef" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250454    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee1f948f-33f3-4da6-895d-0f2e0ef2b7fc" containerName="istio-proxy"
Oct 30 22:14:30.250470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.250461    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b8d46bd-7815-4c9b-b3bf-a88121558e3a" containerName="maas-api"
Oct 30 22:14:30.261528 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.261497    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.300379 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.300353    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"]
Oct 30 22:14:30.300757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.300743    5575 cpu_manager.go:414] "containerMap: removing container" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy"
Oct 30 22:14:30.300757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.300756    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy"
Oct 30 22:14:30.300891 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.300845    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5c98795-1764-46b9-a95f-c084ef7f32c5" containerName="istio-proxy"
Oct 30 22:14:30.303871 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.303852    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"]
Oct 30 22:14:30.304018 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.303999    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.307165 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.307149    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.347769 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.347739    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lfxgk\""
Oct 30 22:14:30.358496 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.358468    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"]
Oct 30 22:14:30.410022 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.409996    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"]
Oct 30 22:14:30.412766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.412743    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"]
Oct 30 22:14:30.417705 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.417683    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.417799 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.417716    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.417799 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.417740    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.417915 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.417844    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.417951 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.417911    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.417951 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.417931    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.418049 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.417950    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.418049 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418002    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.418049 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418024    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.418049 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418043    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.418205 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418062    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.418205 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418115    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndq2s\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-kube-api-access-ndq2s\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.418205 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418174    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.418205 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418197    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.418415 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418212    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.418415 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418262    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94aaf2f0-2807-4984-b257-87721376140b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.418415 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418347    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.418415 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418386    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.418604 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418446    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phsp6\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-kube-api-access-phsp6\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.418604 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418510    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pcq7\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-kube-api-access-7pcq7\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.418604 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418539    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a568811c-c487-4c5c-a787-d629df1b57a8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.418604 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418565    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.418765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418611    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.418765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418670    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94aaf2f0-2807-4984-b257-87721376140b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.418765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418710    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.418765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418735    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a568811c-c487-4c5c-a787-d629df1b57a8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.418765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.418753    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.519509 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519437    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.519509 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519470    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.519509 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519490    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.519776 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519602    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.519776 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519632    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndq2s\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-kube-api-access-ndq2s\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.519892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519781    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.519892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519827    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.519892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519850    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.519892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519860    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.519892 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519877    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519914    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94aaf2f0-2807-4984-b257-87721376140b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.519957    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520014    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520043    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phsp6\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-kube-api-access-phsp6\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520065    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520090    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pcq7\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-kube-api-access-7pcq7\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520126    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a568811c-c487-4c5c-a787-d629df1b57a8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520168    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520187    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520200    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520225    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520251    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94aaf2f0-2807-4984-b257-87721376140b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520291    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520324    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a568811c-c487-4c5c-a787-d629df1b57a8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520355    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520357    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520043    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520413    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520464    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520495    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520525    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520567    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520570    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520584    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520593    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520605    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520628    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520678    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.520916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.520903    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.522123 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.521245    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a568811c-c487-4c5c-a787-d629df1b57a8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.522123 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.521509    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.522123 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.521534    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94aaf2f0-2807-4984-b257-87721376140b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.523245 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.523221    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.523391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.523368    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.523518 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.523489    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.523627 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.523606    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.523874 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.523855    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a568811c-c487-4c5c-a787-d629df1b57a8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.524032 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.524014    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94aaf2f0-2807-4984-b257-87721376140b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.589533 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.589506    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pcq7\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-kube-api-access-7pcq7\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.589811 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.589787    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phsp6\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-kube-api-access-phsp6\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.590911 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.590890    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndq2s\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-kube-api-access-ndq2s\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.649818 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.649789    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-w8pps\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.649950 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.649878    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-7btv2\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:30.653859 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.653837    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-699hj\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.874732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.874642    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:30.918202 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.918174    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:30.923059 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:30.923039    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:31.307937 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.307907    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"]
Oct 30 22:14:31.346379 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:14:31.346340    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976ed6a3_bff2_4e78_85a8_c9b36cffd788.slice/crio-fe2706fef05ccc6cdba02603168328a177cf673c348717acea6acec790a33e34 WatchSource:0}: Error finding container fe2706fef05ccc6cdba02603168328a177cf673c348717acea6acec790a33e34: Status 404 returned error can't find the container with id fe2706fef05ccc6cdba02603168328a177cf673c348717acea6acec790a33e34
Oct 30 22:14:31.348332 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.348299    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.348439 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.348376    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.348439 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.348421    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.361612 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.361589    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"]
Oct 30 22:14:31.362832 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:14:31.362809    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda568811c_c487_4c5c_a787_d629df1b57a8.slice/crio-2bd7fa94206e0ef5b5ee34cbfd79ff97e3a4b7f940005cc1ce11e4aecfb37708 WatchSource:0}: Error finding container 2bd7fa94206e0ef5b5ee34cbfd79ff97e3a4b7f940005cc1ce11e4aecfb37708: Status 404 returned error can't find the container with id 2bd7fa94206e0ef5b5ee34cbfd79ff97e3a4b7f940005cc1ce11e4aecfb37708
Oct 30 22:14:31.364860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.364832    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.364930 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.364912    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.364997 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.364941    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.410438 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.410404    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"]
Oct 30 22:14:31.412406 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:14:31.412376    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94aaf2f0_2807_4984_b257_87721376140b.slice/crio-5f60af1b46911244e624781a7a7ea350a48ca385e64c917c91deb49b43a367d9 WatchSource:0}: Error finding container 5f60af1b46911244e624781a7a7ea350a48ca385e64c917c91deb49b43a367d9: Status 404 returned error can't find the container with id 5f60af1b46911244e624781a7a7ea350a48ca385e64c917c91deb49b43a367d9
Oct 30 22:14:31.415530 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.415496    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.415813 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.415577    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.415813 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.415642    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.844985 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.844929    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" event={"ID":"a568811c-c487-4c5c-a787-d629df1b57a8","Type":"ContainerStarted","Data":"a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877"}
Oct 30 22:14:31.845472 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.845287    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" event={"ID":"a568811c-c487-4c5c-a787-d629df1b57a8","Type":"ContainerStarted","Data":"2bd7fa94206e0ef5b5ee34cbfd79ff97e3a4b7f940005cc1ce11e4aecfb37708"}
Oct 30 22:14:31.846929 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.846903    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" event={"ID":"94aaf2f0-2807-4984-b257-87721376140b","Type":"ContainerStarted","Data":"e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b"}
Oct 30 22:14:31.847140 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.846942    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" event={"ID":"94aaf2f0-2807-4984-b257-87721376140b","Type":"ContainerStarted","Data":"5f60af1b46911244e624781a7a7ea350a48ca385e64c917c91deb49b43a367d9"}
Oct 30 22:14:31.849088 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.849056    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" event={"ID":"976ed6a3-bff2-4e78-85a8-c9b36cffd788","Type":"ContainerStarted","Data":"112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0"}
Oct 30 22:14:31.849174 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.849102    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" event={"ID":"976ed6a3-bff2-4e78-85a8-c9b36cffd788","Type":"ContainerStarted","Data":"fe2706fef05ccc6cdba02603168328a177cf673c348717acea6acec790a33e34"}
Oct 30 22:14:31.879151 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.879062    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:31.923255 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.923204    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:31.923487 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.923290    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:31.977139 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:31.975985    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" podStartSLOduration=1.975935561 podStartE2EDuration="1.975935561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:31.974074211 +0000 UTC m=+3073.005922748" watchObservedRunningTime="2026-10-30 22:14:31.975935561 +0000 UTC m=+3073.007784096"
Oct 30 22:14:32.105841 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:32.105734    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" podStartSLOduration=2.105719662 podStartE2EDuration="2.105719662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:32.102858884 +0000 UTC m=+3073.134707419" watchObservedRunningTime="2026-10-30 22:14:32.105719662 +0000 UTC m=+3073.137568268"
Oct 30 22:14:32.883262 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:32.883220    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-w8pps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused" start-of-body=
Oct 30 22:14:32.883803 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:32.883282    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" podUID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused"
Oct 30 22:14:32.942993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:32.942122    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-7btv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 22:14:32.942993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:32.942202    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" podUID="a568811c-c487-4c5c-a787-d629df1b57a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 22:14:32.942993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:32.942342    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-699hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 22:14:32.942993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:32.942365    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" podUID="94aaf2f0-2807-4984-b257-87721376140b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 22:14:33.875992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:33.875322    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-w8pps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused" start-of-body=
Oct 30 22:14:33.875992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:33.875385    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" podUID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused"
Oct 30 22:14:33.926591 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:33.926552    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-699hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 22:14:33.927229 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:33.927197    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" podUID="94aaf2f0-2807-4984-b257-87721376140b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 22:14:33.927375 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:33.927084    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-7btv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 22:14:33.927490 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:33.927471    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" podUID="a568811c-c487-4c5c-a787-d629df1b57a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 22:14:34.875311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:34.875271    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-w8pps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused" start-of-body=
Oct 30 22:14:34.875617 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:34.875590    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" podUID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused"
Oct 30 22:14:34.921993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:34.919320    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-699hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 22:14:34.921993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:34.919380    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" podUID="94aaf2f0-2807-4984-b257-87721376140b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 22:14:34.929993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:34.927299    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-7btv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 22:14:34.929993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:34.927370    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" podUID="a568811c-c487-4c5c-a787-d629df1b57a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 22:14:35.876369 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:35.876330    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-w8pps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused" start-of-body=
Oct 30 22:14:35.876661 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:35.876630    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" podUID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused"
Oct 30 22:14:35.925580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:35.925541    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-699hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 22:14:35.925831 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:35.925802    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" podUID="94aaf2f0-2807-4984-b257-87721376140b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 22:14:35.926065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:35.926049    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-7btv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 22:14:35.926194 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:35.926177    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" podUID="a568811c-c487-4c5c-a787-d629df1b57a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 22:14:36.877450 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:36.877413    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-w8pps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused" start-of-body=
Oct 30 22:14:36.878139 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:36.878092    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" podUID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused"
Oct 30 22:14:36.920994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:36.919104    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-699hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 22:14:36.920994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:36.919164    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" podUID="94aaf2f0-2807-4984-b257-87721376140b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 22:14:36.937000 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:36.934355    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-7btv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 22:14:36.937000 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:36.934417    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" podUID="a568811c-c487-4c5c-a787-d629df1b57a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 22:14:37.875062 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:37.875024    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-w8pps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused" start-of-body=
Oct 30 22:14:37.875231 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:37.875094    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" podUID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused"
Oct 30 22:14:37.919509 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:37.919471    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-699hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 22:14:37.919881 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:37.919535    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" podUID="94aaf2f0-2807-4984-b257-87721376140b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 22:14:37.923867 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:37.923841    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-7btv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 22:14:37.923931 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:37.923896    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" podUID="a568811c-c487-4c5c-a787-d629df1b57a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 22:14:38.804564 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.804507    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" podStartSLOduration=8.804492215 podStartE2EDuration="8.804492215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:32.244858858 +0000 UTC m=+3073.276707394" watchObservedRunningTime="2026-10-30 22:14:38.804492215 +0000 UTC m=+3079.836340749"
Oct 30 22:14:38.804785 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.804750    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"]
Oct 30 22:14:38.808657 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.808630    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:38.864531 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.864265    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:14:38.875056 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.875021    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-w8pps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused" start-of-body=
Oct 30 22:14:38.875325 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.875296    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" podUID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.155:15021/healthz/ready\": dial tcp 10.132.0.155:15021: connect: connection refused"
Oct 30 22:14:38.899707 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.899656    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jh4j\" (UniqueName: \"kubernetes.io/projected/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-kube-api-access-6jh4j\") pod \"maas-api-revoke-sub-85237e45-8hg5x\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:38.899873 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.899850    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-8hg5x\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:38.899952 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.899903    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-8hg5x\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:38.914174 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.914144    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:14:38.917705 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.917675    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"]
Oct 30 22:14:38.918786 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.918754    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-699hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 22:14:38.918897 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.918816    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" podUID="94aaf2f0-2807-4984-b257-87721376140b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 22:14:38.924094 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.924070    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-7btv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 22:14:38.924409 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:38.924117    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" podUID="a568811c-c487-4c5c-a787-d629df1b57a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 22:14:39.000879 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:39.000839    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-8hg5x\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:39.001104 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:39.000897    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-8hg5x\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:39.001104 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:39.000948    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh4j\" (UniqueName: \"kubernetes.io/projected/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-kube-api-access-6jh4j\") pod \"maas-api-revoke-sub-85237e45-8hg5x\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:39.001766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:39.001732    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-8hg5x\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:39.003936 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:39.003906    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-8hg5x\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:39.066179 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:39.066103    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jh4j\" (UniqueName: \"kubernetes.io/projected/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-kube-api-access-6jh4j\") pod \"maas-api-revoke-sub-85237e45-8hg5x\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:39.122829 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:39.122795    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:39.554710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:39.549132    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"]
Oct 30 22:14:39.954554 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:39.954517    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x" event={"ID":"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6","Type":"ContainerStarted","Data":"36341f7a6ccbc88f85c55ff8503806a7724af78abae9977329961d8fcdc2752e"}
Oct 30 22:14:40.375103 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.375064    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:40.375558 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.375500    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:40.376749 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.376726    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:14:40.398984 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.398936    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:40.399790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.399759    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:40.400747 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.400724    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:14:40.516861 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.516825    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:40.517270 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.517241    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:40.518137 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.518116    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:14:40.963571 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.963489    5575 generic.go:356] "Generic (PLEG): container finished" podID="b2cef76a-3f9c-41b2-a8c8-92139e53ecb6" containerID="3dfffc664ece91c3c1579838adbdeb8f9032ee4555afa68515b4022ddfc61e3b" exitCode=0
Oct 30 22:14:40.963927 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:40.963598    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x" event={"ID":"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6","Type":"ContainerDied","Data":"3dfffc664ece91c3c1579838adbdeb8f9032ee4555afa68515b4022ddfc61e3b"}
Oct 30 22:14:42.115959 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.115936    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:42.163652 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.163615    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-openshift-ca\") pod \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") "
Oct 30 22:14:42.163834 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.163720    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-xks-ca\") pod \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") "
Oct 30 22:14:42.163834 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.163783    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-kube-api-access-6jh4j\" (UniqueName: \"kubernetes.io/projected/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-kube-api-access-6jh4j\") pod \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\" (UID: \"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6\") "
Oct 30 22:14:42.164065 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.164037    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-openshift-ca" pod "b2cef76a-3f9c-41b2-a8c8-92139e53ecb6" (UID: "b2cef76a-3f9c-41b2-a8c8-92139e53ecb6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:42.164185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.164168    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:42.165952 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.165927    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-xks-ca" pod "b2cef76a-3f9c-41b2-a8c8-92139e53ecb6" (UID: "b2cef76a-3f9c-41b2-a8c8-92139e53ecb6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:14:42.166048 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.166014    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-kube-api-access-6jh4j" pod "b2cef76a-3f9c-41b2-a8c8-92139e53ecb6" (UID: "b2cef76a-3f9c-41b2-a8c8-92139e53ecb6"). InnerVolumeSpecName "kube-api-access-6jh4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:42.265384 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.265290    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:42.265384 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.265319    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jh4j\" (UniqueName: \"kubernetes.io/projected/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6-kube-api-access-6jh4j\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:42.977298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.977265    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"
Oct 30 22:14:42.977479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.977310    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x" event={"ID":"b2cef76a-3f9c-41b2-a8c8-92139e53ecb6","Type":"ContainerDied","Data":"36341f7a6ccbc88f85c55ff8503806a7724af78abae9977329961d8fcdc2752e"}
Oct 30 22:14:42.977479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:42.977357    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36341f7a6ccbc88f85c55ff8503806a7724af78abae9977329961d8fcdc2752e"
Oct 30 22:14:45.389515 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.389463    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"]
Oct 30 22:14:45.390033 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.390019    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b2cef76a-3f9c-41b2-a8c8-92139e53ecb6" containerName="revoke-keys"
Oct 30 22:14:45.390088 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.390035    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2cef76a-3f9c-41b2-a8c8-92139e53ecb6" containerName="revoke-keys"
Oct 30 22:14:45.390141 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.390132    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2cef76a-3f9c-41b2-a8c8-92139e53ecb6" containerName="revoke-keys"
Oct 30 22:14:45.393307 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.393290    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.500114 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.500083    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"]
Oct 30 22:14:45.500571 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.500538    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.500720 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.500679    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24wvb\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-kube-api-access-24wvb\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.500790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.500716    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.500847 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.500800    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.500959 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.500843    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.500959 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.500920    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.501105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.501002    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.501105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.501034    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.501186 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.501168    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602244    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24wvb\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-kube-api-access-24wvb\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602292    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602314    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602329    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602360    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602394    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602411    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602486    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602695 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602529    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.602934 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.602918    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.603495 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.603478    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.603735 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.603712    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.604012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.603984    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.604112 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.604092    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.622987 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.621648    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.622987 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.621861    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.681852 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.681773    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24wvb\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-kube-api-access-24wvb\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.683575 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.683547    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-rmjwj\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:45.716006 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:45.711148    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:46.279608 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:46.279576    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"]
Oct 30 22:14:46.283559 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:14:46.282784    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e62be6b_d1ec_45a8_8087_acb36d42c93a.slice/crio-027c934b64306b59031cde312f209c98eca91501d5d8483a4fbb10c128a3d822 WatchSource:0}: Error finding container 027c934b64306b59031cde312f209c98eca91501d5d8483a4fbb10c128a3d822: Status 404 returned error can't find the container with id 027c934b64306b59031cde312f209c98eca91501d5d8483a4fbb10c128a3d822
Oct 30 22:14:46.285764 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:46.285733    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:46.285879 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:46.285807    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:46.285879 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:46.285851    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:47.027990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:47.027784    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" event={"ID":"0e62be6b-d1ec-45a8-8087-acb36d42c93a","Type":"ContainerStarted","Data":"e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03"}
Oct 30 22:14:47.027990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:47.027892    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" event={"ID":"0e62be6b-d1ec-45a8-8087-acb36d42c93a","Type":"ContainerStarted","Data":"027c934b64306b59031cde312f209c98eca91501d5d8483a4fbb10c128a3d822"}
Oct 30 22:14:47.251937 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:47.251884    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podStartSLOduration=2.251870889 podStartE2EDuration="2.251870889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:47.200496805 +0000 UTC m=+3088.232345363" watchObservedRunningTime="2026-10-30 22:14:47.251870889 +0000 UTC m=+3088.283719476"
Oct 30 22:14:47.726992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:47.725557    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:47.726992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:47.725696    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-rmjwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused" start-of-body=
Oct 30 22:14:47.726992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:47.725740    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused"
Oct 30 22:14:48.718381 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:48.718344    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-rmjwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused" start-of-body=
Oct 30 22:14:48.719020 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:48.718953    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused"
Oct 30 22:14:49.726991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:49.719211    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-rmjwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused" start-of-body=
Oct 30 22:14:49.726991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:49.719274    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused"
Oct 30 22:14:50.720086 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:50.720048    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-rmjwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused" start-of-body=
Oct 30 22:14:50.720406 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:50.720374    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused"
Oct 30 22:14:51.365193 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:51.365156    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:51.720998 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:51.717324    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-rmjwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused" start-of-body=
Oct 30 22:14:51.720998 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:51.717384    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused"
Oct 30 22:14:52.717470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:52.717438    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-rmjwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused" start-of-body=
Oct 30 22:14:52.717989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:52.717485    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused"
Oct 30 22:14:53.486621 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:14:53.486586    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:14:53.716525 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:53.716487    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-rmjwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused" start-of-body=
Oct 30 22:14:53.716701 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:53.716547    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.159:15021/healthz/ready\": dial tcp 10.132.0.159:15021: connect: connection refused"
Oct 30 22:14:53.736596 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:53.736550    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:54.720869 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:54.720839    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:54.721278 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:54.721260    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:54.721930 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:54.721914    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:14:56.820364 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:56.820325    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:58.724664 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:14:58.724627    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:00.164881 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.164847    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"]
Oct 30 22:15:00.168523 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.168504    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:00.223996 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.223952    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:15:00.227050 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.227026    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"]
Oct 30 22:15:00.271660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.271628    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djxz\" (UniqueName: \"kubernetes.io/projected/9fc5384f-011c-4530-aa58-3e4ff8b164fe-kube-api-access-7djxz\") pod \"maas-api-key-cleanup-29889975-ftbtg\" (UID: \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:00.271776 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.271670    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc5384f-011c-4530-aa58-3e4ff8b164fe-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889975-ftbtg\" (UID: \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:00.373129 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.373089    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djxz\" (UniqueName: \"kubernetes.io/projected/9fc5384f-011c-4530-aa58-3e4ff8b164fe-kube-api-access-7djxz\") pod \"maas-api-key-cleanup-29889975-ftbtg\" (UID: \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:00.373329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.373137    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc5384f-011c-4530-aa58-3e4ff8b164fe-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889975-ftbtg\" (UID: \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:00.373820 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.373798    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc5384f-011c-4530-aa58-3e4ff8b164fe-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889975-ftbtg\" (UID: \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:00.434688 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.434618    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djxz\" (UniqueName: \"kubernetes.io/projected/9fc5384f-011c-4530-aa58-3e4ff8b164fe-kube-api-access-7djxz\") pod \"maas-api-key-cleanup-29889975-ftbtg\" (UID: \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:00.482361 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.482330    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:00.860991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:00.860943    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"]
Oct 30 22:15:00.861659 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:15:00.861623    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc5384f_011c_4530_aa58_3e4ff8b164fe.slice/crio-5a30ece6b02978860917a286a8fdb7c79dc1bbb956ad3b33beef8209d65a1eaa WatchSource:0}: Error finding container 5a30ece6b02978860917a286a8fdb7c79dc1bbb956ad3b33beef8209d65a1eaa: Status 404 returned error can't find the container with id 5a30ece6b02978860917a286a8fdb7c79dc1bbb956ad3b33beef8209d65a1eaa
Oct 30 22:15:01.116460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:01.116328    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg" event={"ID":"9fc5384f-011c-4530-aa58-3e4ff8b164fe","Type":"ContainerStarted","Data":"5a30ece6b02978860917a286a8fdb7c79dc1bbb956ad3b33beef8209d65a1eaa"}
Oct 30 22:15:02.124318 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:02.124287    5575 generic.go:356] "Generic (PLEG): container finished" podID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerID="7b692498a96e4e18f8ddfa729616e233801ed62da52ec4b1dbefe3d3f93357ab" exitCode=60
Oct 30 22:15:02.124755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:02.124345    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg" event={"ID":"9fc5384f-011c-4530-aa58-3e4ff8b164fe","Type":"ContainerDied","Data":"7b692498a96e4e18f8ddfa729616e233801ed62da52ec4b1dbefe3d3f93357ab"}
Oct 30 22:15:02.124755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:02.124646    5575 scope.go:122] "RemoveContainer" containerID="7b692498a96e4e18f8ddfa729616e233801ed62da52ec4b1dbefe3d3f93357ab"
Oct 30 22:15:03.135270 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:03.135238    5575 generic.go:356] "Generic (PLEG): container finished" podID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerID="673c4f87aeb42ff5953590f375c392346df1b6adba7d0e8d1c265a8f4731de5a" exitCode=60
Oct 30 22:15:03.135703 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:03.135360    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg" event={"ID":"9fc5384f-011c-4530-aa58-3e4ff8b164fe","Type":"ContainerDied","Data":"673c4f87aeb42ff5953590f375c392346df1b6adba7d0e8d1c265a8f4731de5a"}
Oct 30 22:15:03.135703 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:03.135410    5575 scope.go:122] "RemoveContainer" containerID="7b692498a96e4e18f8ddfa729616e233801ed62da52ec4b1dbefe3d3f93357ab"
Oct 30 22:15:03.135703 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:03.135536    5575 scope.go:122] "RemoveContainer" containerID="673c4f87aeb42ff5953590f375c392346df1b6adba7d0e8d1c265a8f4731de5a"
Oct 30 22:15:03.135840 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:15:03.135777    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889975-ftbtg_odh-ai-gateway-infra(9fc5384f-011c-4530-aa58-3e4ff8b164fe)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe"
Oct 30 22:15:04.144144 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:04.144117    5575 scope.go:122] "RemoveContainer" containerID="673c4f87aeb42ff5953590f375c392346df1b6adba7d0e8d1c265a8f4731de5a"
Oct 30 22:15:04.144530 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:15:04.144344    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889975-ftbtg_odh-ai-gateway-infra(9fc5384f-011c-4530-aa58-3e4ff8b164fe)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe"
Oct 30 22:15:14.119481 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:14.119445    5575 scope.go:122] "RemoveContainer" containerID="673c4f87aeb42ff5953590f375c392346df1b6adba7d0e8d1c265a8f4731de5a"
Oct 30 22:15:15.211788 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:15.211759    5575 generic.go:356] "Generic (PLEG): container finished" podID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerID="b70daa53f3f6b6abce9a02646a470ec2ebcf19391541aaf78369b87f19d12b4b" exitCode=60
Oct 30 22:15:15.212233 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:15.211829    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg" event={"ID":"9fc5384f-011c-4530-aa58-3e4ff8b164fe","Type":"ContainerDied","Data":"b70daa53f3f6b6abce9a02646a470ec2ebcf19391541aaf78369b87f19d12b4b"}
Oct 30 22:15:15.212233 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:15.211883    5575 scope.go:122] "RemoveContainer" containerID="673c4f87aeb42ff5953590f375c392346df1b6adba7d0e8d1c265a8f4731de5a"
Oct 30 22:15:15.212233 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:15.212197    5575 scope.go:122] "RemoveContainer" containerID="b70daa53f3f6b6abce9a02646a470ec2ebcf19391541aaf78369b87f19d12b4b"
Oct 30 22:15:15.212457 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:15:15.212428    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29889975-ftbtg_odh-ai-gateway-infra(9fc5384f-011c-4530-aa58-3e4ff8b164fe)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe"
Oct 30 22:15:16.341400 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:16.341368    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"]
Oct 30 22:15:16.494100 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:16.494075    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:16.628356 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:16.628281    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fc5384f-011c-4530-aa58-3e4ff8b164fe-kube-api-access-7djxz\" (UniqueName: \"kubernetes.io/projected/9fc5384f-011c-4530-aa58-3e4ff8b164fe-kube-api-access-7djxz\") pod \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\" (UID: \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\") "
Oct 30 22:15:16.628491 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:16.628390    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fc5384f-011c-4530-aa58-3e4ff8b164fe-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc5384f-011c-4530-aa58-3e4ff8b164fe-maas-api-service-ca\") pod \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\" (UID: \"9fc5384f-011c-4530-aa58-3e4ff8b164fe\") "
Oct 30 22:15:16.628860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:16.628824    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc5384f-011c-4530-aa58-3e4ff8b164fe-maas-api-service-ca" pod "9fc5384f-011c-4530-aa58-3e4ff8b164fe" (UID: "9fc5384f-011c-4530-aa58-3e4ff8b164fe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:16.630725 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:16.630698    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc5384f-011c-4530-aa58-3e4ff8b164fe-kube-api-access-7djxz" pod "9fc5384f-011c-4530-aa58-3e4ff8b164fe" (UID: "9fc5384f-011c-4530-aa58-3e4ff8b164fe"). InnerVolumeSpecName "kube-api-access-7djxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:16.729357 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:16.729326    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7djxz\" (UniqueName: \"kubernetes.io/projected/9fc5384f-011c-4530-aa58-3e4ff8b164fe-kube-api-access-7djxz\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:16.729357 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:16.729353    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc5384f-011c-4530-aa58-3e4ff8b164fe-maas-api-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:17.226518 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:17.226488    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg" event={"ID":"9fc5384f-011c-4530-aa58-3e4ff8b164fe","Type":"ContainerDied","Data":"5a30ece6b02978860917a286a8fdb7c79dc1bbb956ad3b33beef8209d65a1eaa"}
Oct 30 22:15:17.226675 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:17.226525    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"
Oct 30 22:15:17.226675 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:17.226546    5575 scope.go:122] "RemoveContainer" containerID="b70daa53f3f6b6abce9a02646a470ec2ebcf19391541aaf78369b87f19d12b4b"
Oct 30 22:15:17.391650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:17.391576    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"]
Oct 30 22:15:17.441376 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:17.441346    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-ftbtg"]
Oct 30 22:15:19.125751 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:19.125719    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" path="/var/lib/kubelet/pods/9fc5384f-011c-4530-aa58-3e4ff8b164fe/volumes"
Oct 30 22:15:23.486626 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:15:23.486584    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:15:46.699771 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:46.699718    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:47.767633 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:47.767601    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:48.071701 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.071622    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"]
Oct 30 22:15:48.072066 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.072052    5575 cpu_manager.go:414] "containerMap: removing container" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerName="cleanup"
Oct 30 22:15:48.072118 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.072066    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerName="cleanup"
Oct 30 22:15:48.072118 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.072089    5575 cpu_manager.go:414] "containerMap: removing container" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerName="cleanup"
Oct 30 22:15:48.072118 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.072094    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerName="cleanup"
Oct 30 22:15:48.072118 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.072119    5575 cpu_manager.go:414] "containerMap: removing container" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerName="cleanup"
Oct 30 22:15:48.072273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.072123    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerName="cleanup"
Oct 30 22:15:48.072273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.072189    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerName="cleanup"
Oct 30 22:15:48.072273 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.072197    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerName="cleanup"
Oct 30 22:15:48.075294 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.075278    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.128561 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.128537    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:15:48.178309 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.178285    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:15:48.180937 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.180914    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"]
Oct 30 22:15:48.191765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.191732    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-dxkz6\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.191886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.191813    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftpnk\" (UniqueName: \"kubernetes.io/projected/59c33158-ae72-41bd-8a90-c443d6f584aa-kube-api-access-ftpnk\") pod \"maas-api-revoke-sub-c1e271a9-dxkz6\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.192018 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.191986    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-dxkz6\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.293563 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.293535    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-dxkz6\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.293682 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.293581    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftpnk\" (UniqueName: \"kubernetes.io/projected/59c33158-ae72-41bd-8a90-c443d6f584aa-kube-api-access-ftpnk\") pod \"maas-api-revoke-sub-c1e271a9-dxkz6\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.293682 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.293619    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-dxkz6\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.294303 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.294238    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-dxkz6\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.295955 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.295935    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-dxkz6\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.355876 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.355820    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftpnk\" (UniqueName: \"kubernetes.io/projected/59c33158-ae72-41bd-8a90-c443d6f584aa-kube-api-access-ftpnk\") pod \"maas-api-revoke-sub-c1e271a9-dxkz6\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.388510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.388490    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:48.762621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:48.762594    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"]
Oct 30 22:15:48.764641 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:15:48.764610    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c33158_ae72_41bd_8a90_c443d6f584aa.slice/crio-da79252776e3cf943fa59ff7e43b659da4503958236199fcd86057282c7eb4c7 WatchSource:0}: Error finding container da79252776e3cf943fa59ff7e43b659da4503958236199fcd86057282c7eb4c7: Status 404 returned error can't find the container with id da79252776e3cf943fa59ff7e43b659da4503958236199fcd86057282c7eb4c7
Oct 30 22:15:49.460243 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:49.460206    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6" event={"ID":"59c33158-ae72-41bd-8a90-c443d6f584aa","Type":"ContainerStarted","Data":"da0bb0a2e7e7641f09fd670acbc1a51933dfd8a730ab67ea540b0c28aedef147"}
Oct 30 22:15:49.460640 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:49.460263    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6" event={"ID":"59c33158-ae72-41bd-8a90-c443d6f584aa","Type":"ContainerStarted","Data":"da79252776e3cf943fa59ff7e43b659da4503958236199fcd86057282c7eb4c7"}
Oct 30 22:15:49.578283 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:49.578225    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6" podStartSLOduration=1.578206373 podStartE2EDuration="1.578206373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:49.577142022 +0000 UTC m=+3150.608990558" watchObservedRunningTime="2026-10-30 22:15:49.578206373 +0000 UTC m=+3150.610054910"
Oct 30 22:15:50.467530 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:50.467492    5575 generic.go:356] "Generic (PLEG): container finished" podID="59c33158-ae72-41bd-8a90-c443d6f584aa" containerID="da0bb0a2e7e7641f09fd670acbc1a51933dfd8a730ab67ea540b0c28aedef147" exitCode=0
Oct 30 22:15:50.467916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:50.467579    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6" event={"ID":"59c33158-ae72-41bd-8a90-c443d6f584aa","Type":"ContainerDied","Data":"da0bb0a2e7e7641f09fd670acbc1a51933dfd8a730ab67ea540b0c28aedef147"}
Oct 30 22:15:51.616472 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.616447    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:51.729802 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.729726    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-xks-ca\") pod \"59c33158-ae72-41bd-8a90-c443d6f584aa\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") "
Oct 30 22:15:51.729959 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.729877    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59c33158-ae72-41bd-8a90-c443d6f584aa-kube-api-access-ftpnk\" (UniqueName: \"kubernetes.io/projected/59c33158-ae72-41bd-8a90-c443d6f584aa-kube-api-access-ftpnk\") pod \"59c33158-ae72-41bd-8a90-c443d6f584aa\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") "
Oct 30 22:15:51.729959 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.729912    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-openshift-ca\") pod \"59c33158-ae72-41bd-8a90-c443d6f584aa\" (UID: \"59c33158-ae72-41bd-8a90-c443d6f584aa\") "
Oct 30 22:15:51.730290 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.730263    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-openshift-ca" pod "59c33158-ae72-41bd-8a90-c443d6f584aa" (UID: "59c33158-ae72-41bd-8a90-c443d6f584aa"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:51.732541 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.732516    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-xks-ca" pod "59c33158-ae72-41bd-8a90-c443d6f584aa" (UID: "59c33158-ae72-41bd-8a90-c443d6f584aa"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:15:51.732541 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.732522    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c33158-ae72-41bd-8a90-c443d6f584aa-kube-api-access-ftpnk" pod "59c33158-ae72-41bd-8a90-c443d6f584aa" (UID: "59c33158-ae72-41bd-8a90-c443d6f584aa"). InnerVolumeSpecName "kube-api-access-ftpnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:51.831227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.831194    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftpnk\" (UniqueName: \"kubernetes.io/projected/59c33158-ae72-41bd-8a90-c443d6f584aa-kube-api-access-ftpnk\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:51.831227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.831223    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:51.831227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:51.831233    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/59c33158-ae72-41bd-8a90-c443d6f584aa-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:52.479697 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:52.479664    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"
Oct 30 22:15:52.479867 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:52.479692    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6" event={"ID":"59c33158-ae72-41bd-8a90-c443d6f584aa","Type":"ContainerDied","Data":"da79252776e3cf943fa59ff7e43b659da4503958236199fcd86057282c7eb4c7"}
Oct 30 22:15:52.479867 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:52.479744    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da79252776e3cf943fa59ff7e43b659da4503958236199fcd86057282c7eb4c7"
Oct 30 22:15:53.487074 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:15:53.487035    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:15:59.075811 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:15:59.075761    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:19.356875 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.356843    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"]
Oct 30 22:16:19.358238 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.358204    5575 cpu_manager.go:414] "containerMap: removing container" podUID="59c33158-ae72-41bd-8a90-c443d6f584aa" containerName="revoke-keys"
Oct 30 22:16:19.358238 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.358238    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59c33158-ae72-41bd-8a90-c443d6f584aa" containerName="revoke-keys"
Oct 30 22:16:19.358526 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.358512    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="59c33158-ae72-41bd-8a90-c443d6f584aa" containerName="revoke-keys"
Oct 30 22:16:19.358588 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.358541    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fc5384f-011c-4530-aa58-3e4ff8b164fe" containerName="cleanup"
Oct 30 22:16:19.362764 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.362735    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.419325 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.419296    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"]
Oct 30 22:16:19.422889 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.422867    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-cr8rb\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.423048 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.422906    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-cr8rb\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.423106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.423075    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lncn\" (UniqueName: \"kubernetes.io/projected/a732d2fc-58c6-410f-aae1-cbfcab1d220f-kube-api-access-5lncn\") pod \"maas-api-revoke-sub-2e1f5b5f-cr8rb\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.465836 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.465809    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:16:19.466045 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.465912    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:16:19.523913 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.523874    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-cr8rb\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.524124 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.524009    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lncn\" (UniqueName: \"kubernetes.io/projected/a732d2fc-58c6-410f-aae1-cbfcab1d220f-kube-api-access-5lncn\") pod \"maas-api-revoke-sub-2e1f5b5f-cr8rb\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.524124 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.524114    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-cr8rb\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.524704 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.524680    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-cr8rb\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.526540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.526521    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-cr8rb\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.585486 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.585460    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lncn\" (UniqueName: \"kubernetes.io/projected/a732d2fc-58c6-410f-aae1-cbfcab1d220f-kube-api-access-5lncn\") pod \"maas-api-revoke-sub-2e1f5b5f-cr8rb\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:19.677055 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:19.677030    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:20.052140 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:20.052112    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"]
Oct 30 22:16:20.053455 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:16:20.053431    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda732d2fc_58c6_410f_aae1_cbfcab1d220f.slice/crio-cec1fb00dfb2ae4763a0b7a56d2fb28a6cde133491d6e74383733623febe2d08 WatchSource:0}: Error finding container cec1fb00dfb2ae4763a0b7a56d2fb28a6cde133491d6e74383733623febe2d08: Status 404 returned error can't find the container with id cec1fb00dfb2ae4763a0b7a56d2fb28a6cde133491d6e74383733623febe2d08
Oct 30 22:16:20.755994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:20.755926    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb" event={"ID":"a732d2fc-58c6-410f-aae1-cbfcab1d220f","Type":"ContainerStarted","Data":"8a9142540d13f5d2bec0940ff8b145b1a2b358fb7d45ca7aadcfef8092520983"}
Oct 30 22:16:20.756384 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:20.756022    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb" event={"ID":"a732d2fc-58c6-410f-aae1-cbfcab1d220f","Type":"ContainerStarted","Data":"cec1fb00dfb2ae4763a0b7a56d2fb28a6cde133491d6e74383733623febe2d08"}
Oct 30 22:16:20.874081 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:20.874034    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb" podStartSLOduration=1.87402026 podStartE2EDuration="1.87402026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:20.872380844 +0000 UTC m=+3181.904229380" watchObservedRunningTime="2026-10-30 22:16:20.87402026 +0000 UTC m=+3181.905868795"
Oct 30 22:16:21.763672 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:21.763635    5575 generic.go:356] "Generic (PLEG): container finished" podID="a732d2fc-58c6-410f-aae1-cbfcab1d220f" containerID="8a9142540d13f5d2bec0940ff8b145b1a2b358fb7d45ca7aadcfef8092520983" exitCode=0
Oct 30 22:16:21.764091 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:21.763724    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb" event={"ID":"a732d2fc-58c6-410f-aae1-cbfcab1d220f","Type":"ContainerDied","Data":"8a9142540d13f5d2bec0940ff8b145b1a2b358fb7d45ca7aadcfef8092520983"}
Oct 30 22:16:22.921040 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:22.921015    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:22.950393 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:22.950370    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a732d2fc-58c6-410f-aae1-cbfcab1d220f-kube-api-access-5lncn\" (UniqueName: \"kubernetes.io/projected/a732d2fc-58c6-410f-aae1-cbfcab1d220f-kube-api-access-5lncn\") pod \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") "
Oct 30 22:16:22.950473 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:22.950403    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-xks-ca\") pod \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") "
Oct 30 22:16:22.950511 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:22.950475    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-openshift-ca\") pod \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\" (UID: \"a732d2fc-58c6-410f-aae1-cbfcab1d220f\") "
Oct 30 22:16:22.950861 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:22.950837    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-openshift-ca" pod "a732d2fc-58c6-410f-aae1-cbfcab1d220f" (UID: "a732d2fc-58c6-410f-aae1-cbfcab1d220f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:22.952611 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:22.952582    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a732d2fc-58c6-410f-aae1-cbfcab1d220f-kube-api-access-5lncn" pod "a732d2fc-58c6-410f-aae1-cbfcab1d220f" (UID: "a732d2fc-58c6-410f-aae1-cbfcab1d220f"). InnerVolumeSpecName "kube-api-access-5lncn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:22.952679 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:22.952639    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-xks-ca" pod "a732d2fc-58c6-410f-aae1-cbfcab1d220f" (UID: "a732d2fc-58c6-410f-aae1-cbfcab1d220f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:16:23.051803 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:23.051735    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lncn\" (UniqueName: \"kubernetes.io/projected/a732d2fc-58c6-410f-aae1-cbfcab1d220f-kube-api-access-5lncn\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:23.051803 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:23.051765    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:23.051803 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:23.051775    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a732d2fc-58c6-410f-aae1-cbfcab1d220f-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:23.485697 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:16:23.485655    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:16:23.776369 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:23.776286    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"
Oct 30 22:16:23.776369 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:23.776312    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb" event={"ID":"a732d2fc-58c6-410f-aae1-cbfcab1d220f","Type":"ContainerDied","Data":"cec1fb00dfb2ae4763a0b7a56d2fb28a6cde133491d6e74383733623febe2d08"}
Oct 30 22:16:23.776369 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:23.776360    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cec1fb00dfb2ae4763a0b7a56d2fb28a6cde133491d6e74383733623febe2d08"
Oct 30 22:16:31.808115 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.808080    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"]
Oct 30 22:16:31.808581 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.808570    5575 cpu_manager.go:414] "containerMap: removing container" podUID="a732d2fc-58c6-410f-aae1-cbfcab1d220f" containerName="revoke-keys"
Oct 30 22:16:31.808636 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.808583    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a732d2fc-58c6-410f-aae1-cbfcab1d220f" containerName="revoke-keys"
Oct 30 22:16:31.808694 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.808682    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="a732d2fc-58c6-410f-aae1-cbfcab1d220f" containerName="revoke-keys"
Oct 30 22:16:31.812078 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.812056    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:31.834998 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.834952    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ec843018-78rwg\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:31.835151 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.835105    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442mj\" (UniqueName: \"kubernetes.io/projected/3a261cd9-c03f-419c-9851-a9016aa792b3-kube-api-access-442mj\") pod \"maas-api-revoke-sub-ec843018-78rwg\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:31.835222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.835171    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ec843018-78rwg\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:31.866516 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.866461    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:16:31.870742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.870710    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"]
Oct 30 22:16:31.916254 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.916232    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:16:31.935898 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.935872    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ec843018-78rwg\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:31.936067 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.935922    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-442mj\" (UniqueName: \"kubernetes.io/projected/3a261cd9-c03f-419c-9851-a9016aa792b3-kube-api-access-442mj\") pod \"maas-api-revoke-sub-ec843018-78rwg\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:31.936067 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.936001    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ec843018-78rwg\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:31.936638 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.936618    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ec843018-78rwg\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:31.938423 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.938397    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ec843018-78rwg\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:31.998713 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:31.998686    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-442mj\" (UniqueName: \"kubernetes.io/projected/3a261cd9-c03f-419c-9851-a9016aa792b3-kube-api-access-442mj\") pod \"maas-api-revoke-sub-ec843018-78rwg\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:32.127591 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:32.127499    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:32.508955 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:32.508932    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"]
Oct 30 22:16:32.510828 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:16:32.510799    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a261cd9_c03f_419c_9851_a9016aa792b3.slice/crio-7641fa132a9458d71e052124e14b11bbf7d87c7cf57c7023eb4de13dea941eb5 WatchSource:0}: Error finding container 7641fa132a9458d71e052124e14b11bbf7d87c7cf57c7023eb4de13dea941eb5: Status 404 returned error can't find the container with id 7641fa132a9458d71e052124e14b11bbf7d87c7cf57c7023eb4de13dea941eb5
Oct 30 22:16:32.832376 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:32.832344    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg" event={"ID":"3a261cd9-c03f-419c-9851-a9016aa792b3","Type":"ContainerStarted","Data":"8b964982fbbc574333466c67368fa90c3951a87eeb57b75734b5893b37dc8168"}
Oct 30 22:16:32.832698 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:32.832400    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg" event={"ID":"3a261cd9-c03f-419c-9851-a9016aa792b3","Type":"ContainerStarted","Data":"7641fa132a9458d71e052124e14b11bbf7d87c7cf57c7023eb4de13dea941eb5"}
Oct 30 22:16:32.949071 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:32.949030    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg" podStartSLOduration=1.94901287 podStartE2EDuration="1.94901287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:32.94829072 +0000 UTC m=+3193.980139259" watchObservedRunningTime="2026-10-30 22:16:32.94901287 +0000 UTC m=+3193.980861409"
Oct 30 22:16:33.840623 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:33.840582    5575 generic.go:356] "Generic (PLEG): container finished" podID="3a261cd9-c03f-419c-9851-a9016aa792b3" containerID="8b964982fbbc574333466c67368fa90c3951a87eeb57b75734b5893b37dc8168" exitCode=0
Oct 30 22:16:33.841008 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:33.840676    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg" event={"ID":"3a261cd9-c03f-419c-9851-a9016aa792b3","Type":"ContainerDied","Data":"8b964982fbbc574333466c67368fa90c3951a87eeb57b75734b5893b37dc8168"}
Oct 30 22:16:34.990735 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:34.990711    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:35.067759 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.067731    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-xks-ca\") pod \"3a261cd9-c03f-419c-9851-a9016aa792b3\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") "
Oct 30 22:16:35.067902 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.067795    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-openshift-ca\") pod \"3a261cd9-c03f-419c-9851-a9016aa792b3\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") "
Oct 30 22:16:35.067902 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.067826    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a261cd9-c03f-419c-9851-a9016aa792b3-kube-api-access-442mj\" (UniqueName: \"kubernetes.io/projected/3a261cd9-c03f-419c-9851-a9016aa792b3-kube-api-access-442mj\") pod \"3a261cd9-c03f-419c-9851-a9016aa792b3\" (UID: \"3a261cd9-c03f-419c-9851-a9016aa792b3\") "
Oct 30 22:16:35.068260 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.068236    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-openshift-ca" pod "3a261cd9-c03f-419c-9851-a9016aa792b3" (UID: "3a261cd9-c03f-419c-9851-a9016aa792b3"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:35.070073 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.070043    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-xks-ca" pod "3a261cd9-c03f-419c-9851-a9016aa792b3" (UID: "3a261cd9-c03f-419c-9851-a9016aa792b3"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:16:35.070168 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.070142    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a261cd9-c03f-419c-9851-a9016aa792b3-kube-api-access-442mj" pod "3a261cd9-c03f-419c-9851-a9016aa792b3" (UID: "3a261cd9-c03f-419c-9851-a9016aa792b3"). InnerVolumeSpecName "kube-api-access-442mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:35.169395 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.169355    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:35.169395 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.169391    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a261cd9-c03f-419c-9851-a9016aa792b3-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:35.169568 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.169405    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-442mj\" (UniqueName: \"kubernetes.io/projected/3a261cd9-c03f-419c-9851-a9016aa792b3-kube-api-access-442mj\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:35.853298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.853268    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"
Oct 30 22:16:35.853298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.853273    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg" event={"ID":"3a261cd9-c03f-419c-9851-a9016aa792b3","Type":"ContainerDied","Data":"7641fa132a9458d71e052124e14b11bbf7d87c7cf57c7023eb4de13dea941eb5"}
Oct 30 22:16:35.853557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:35.853322    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7641fa132a9458d71e052124e14b11bbf7d87c7cf57c7023eb4de13dea941eb5"
Oct 30 22:16:53.025122 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:53.025086    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:53.486305 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:16:53.486270    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:16:59.410554 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:16:59.410515    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:12.599113 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:12.599081    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:18.430621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.430587    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"]
Oct 30 22:17:18.431059 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.431045    5575 cpu_manager.go:414] "containerMap: removing container" podUID="3a261cd9-c03f-419c-9851-a9016aa792b3" containerName="revoke-keys"
Oct 30 22:17:18.431108 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.431060    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a261cd9-c03f-419c-9851-a9016aa792b3" containerName="revoke-keys"
Oct 30 22:17:18.431143 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.431133    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a261cd9-c03f-419c-9851-a9016aa792b3" containerName="revoke-keys"
Oct 30 22:17:18.434388 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.434369    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.492433 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.492406    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"]
Oct 30 22:17:18.536601 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.536564    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-wjvrj\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.536778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.536618    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbbrf\" (UniqueName: \"kubernetes.io/projected/6e5dc00e-4413-4c61-8133-e367890c2b53-kube-api-access-pbbrf\") pod \"maas-api-revoke-sub-046e1343-wjvrj\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.536778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.536747    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-wjvrj\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.538860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.538840    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:17:18.539023 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.539005    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:17:18.637732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.637705    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-wjvrj\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.637863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.637750    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbbrf\" (UniqueName: \"kubernetes.io/projected/6e5dc00e-4413-4c61-8133-e367890c2b53-kube-api-access-pbbrf\") pod \"maas-api-revoke-sub-046e1343-wjvrj\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.637863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.637785    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-wjvrj\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.638334 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.638314    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-wjvrj\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.640298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.640275    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-wjvrj\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.699442 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.699371    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbbrf\" (UniqueName: \"kubernetes.io/projected/6e5dc00e-4413-4c61-8133-e367890c2b53-kube-api-access-pbbrf\") pod \"maas-api-revoke-sub-046e1343-wjvrj\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:18.747994 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:18.747957    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:19.125600 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:17:19.125558    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5dc00e_4413_4c61_8133_e367890c2b53.slice/crio-7a19837de691940476986369353ffa014e9285dce7967777941571101b250dfd WatchSource:0}: Error finding container 7a19837de691940476986369353ffa014e9285dce7967777941571101b250dfd: Status 404 returned error can't find the container with id 7a19837de691940476986369353ffa014e9285dce7967777941571101b250dfd
Oct 30 22:17:19.126818 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:19.126689    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"]
Oct 30 22:17:20.132579 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:20.132549    5575 generic.go:356] "Generic (PLEG): container finished" podID="6e5dc00e-4413-4c61-8133-e367890c2b53" containerID="61b7f913576a534527547688503bd3ad604c6be9e398b94de95470cf17e1cfde" exitCode=0
Oct 30 22:17:20.132946 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:20.132635    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj" event={"ID":"6e5dc00e-4413-4c61-8133-e367890c2b53","Type":"ContainerDied","Data":"61b7f913576a534527547688503bd3ad604c6be9e398b94de95470cf17e1cfde"}
Oct 30 22:17:20.132946 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:20.132685    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj" event={"ID":"6e5dc00e-4413-4c61-8133-e367890c2b53","Type":"ContainerStarted","Data":"7a19837de691940476986369353ffa014e9285dce7967777941571101b250dfd"}
Oct 30 22:17:21.294567 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.294544    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:21.366314 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.366288    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-xks-ca\") pod \"6e5dc00e-4413-4c61-8133-e367890c2b53\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") "
Oct 30 22:17:21.366431 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.366401    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-openshift-ca\") pod \"6e5dc00e-4413-4c61-8133-e367890c2b53\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") "
Oct 30 22:17:21.366508 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.366493    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e5dc00e-4413-4c61-8133-e367890c2b53-kube-api-access-pbbrf\" (UniqueName: \"kubernetes.io/projected/6e5dc00e-4413-4c61-8133-e367890c2b53-kube-api-access-pbbrf\") pod \"6e5dc00e-4413-4c61-8133-e367890c2b53\" (UID: \"6e5dc00e-4413-4c61-8133-e367890c2b53\") "
Oct 30 22:17:21.366734 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.366712    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-openshift-ca" pod "6e5dc00e-4413-4c61-8133-e367890c2b53" (UID: "6e5dc00e-4413-4c61-8133-e367890c2b53"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:21.368567 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.368544    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-xks-ca" pod "6e5dc00e-4413-4c61-8133-e367890c2b53" (UID: "6e5dc00e-4413-4c61-8133-e367890c2b53"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:17:21.368665 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.368627    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5dc00e-4413-4c61-8133-e367890c2b53-kube-api-access-pbbrf" pod "6e5dc00e-4413-4c61-8133-e367890c2b53" (UID: "6e5dc00e-4413-4c61-8133-e367890c2b53"). InnerVolumeSpecName "kube-api-access-pbbrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:21.468256 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.468196    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:21.468256 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.468219    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbbrf\" (UniqueName: \"kubernetes.io/projected/6e5dc00e-4413-4c61-8133-e367890c2b53-kube-api-access-pbbrf\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:21.468256 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:21.468229    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e5dc00e-4413-4c61-8133-e367890c2b53-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:22.144212 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:22.144181    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"
Oct 30 22:17:22.144412 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:22.144206    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj" event={"ID":"6e5dc00e-4413-4c61-8133-e367890c2b53","Type":"ContainerDied","Data":"7a19837de691940476986369353ffa014e9285dce7967777941571101b250dfd"}
Oct 30 22:17:22.144412 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:22.144259    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a19837de691940476986369353ffa014e9285dce7967777941571101b250dfd"
Oct 30 22:17:23.484653 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:17:23.484604    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:17:39.241506 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.241426    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"]
Oct 30 22:17:39.242074 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.241874    5575 cpu_manager.go:414] "containerMap: removing container" podUID="6e5dc00e-4413-4c61-8133-e367890c2b53" containerName="revoke-keys"
Oct 30 22:17:39.242074 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.241885    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e5dc00e-4413-4c61-8133-e367890c2b53" containerName="revoke-keys"
Oct 30 22:17:39.242074 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.241958    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e5dc00e-4413-4c61-8133-e367890c2b53" containerName="revoke-keys"
Oct 30 22:17:39.245239 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.245218    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.304249 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.304218    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"]
Oct 30 22:17:39.350394 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.350366    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:17:39.350557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.350418    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:17:39.428461 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.428433    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-vg2nx\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.428614 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.428555    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjtq\" (UniqueName: \"kubernetes.io/projected/16b60c3f-f905-4e66-a401-dfa2554f803f-kube-api-access-psjtq\") pod \"maas-api-revoke-sub-d3fba056-vg2nx\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.428664 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.428622    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-vg2nx\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.529728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.529649    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-vg2nx\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.529898 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.529756    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psjtq\" (UniqueName: \"kubernetes.io/projected/16b60c3f-f905-4e66-a401-dfa2554f803f-kube-api-access-psjtq\") pod \"maas-api-revoke-sub-d3fba056-vg2nx\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.529898 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.529809    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-vg2nx\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.530512 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.530487    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-vg2nx\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.532298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.532275    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-vg2nx\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.590991 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.590938    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjtq\" (UniqueName: \"kubernetes.io/projected/16b60c3f-f905-4e66-a401-dfa2554f803f-kube-api-access-psjtq\") pod \"maas-api-revoke-sub-d3fba056-vg2nx\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:39.858893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:39.858816    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:40.235068 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:40.235044    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"]
Oct 30 22:17:40.236422 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:17:40.236397    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b60c3f_f905_4e66_a401_dfa2554f803f.slice/crio-eb2358f59c394b3b4235138cb7b433b3861268f641b7b4d8552e63a2999ad466 WatchSource:0}: Error finding container eb2358f59c394b3b4235138cb7b433b3861268f641b7b4d8552e63a2999ad466: Status 404 returned error can't find the container with id eb2358f59c394b3b4235138cb7b433b3861268f641b7b4d8552e63a2999ad466
Oct 30 22:17:40.317528 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:40.317502    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx" event={"ID":"16b60c3f-f905-4e66-a401-dfa2554f803f","Type":"ContainerStarted","Data":"eb2358f59c394b3b4235138cb7b433b3861268f641b7b4d8552e63a2999ad466"}
Oct 30 22:17:41.324628 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:41.324544    5575 generic.go:356] "Generic (PLEG): container finished" podID="16b60c3f-f905-4e66-a401-dfa2554f803f" containerID="46b4d3c8739f9eec38bd7f0eaba0b15a02c9a2709cbd24ccdeeb0c7ce4567a38" exitCode=0
Oct 30 22:17:41.324990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:41.324624    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx" event={"ID":"16b60c3f-f905-4e66-a401-dfa2554f803f","Type":"ContainerDied","Data":"46b4d3c8739f9eec38bd7f0eaba0b15a02c9a2709cbd24ccdeeb0c7ce4567a38"}
Oct 30 22:17:42.470141 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.470116    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:42.656360 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.656335    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-openshift-ca\") pod \"16b60c3f-f905-4e66-a401-dfa2554f803f\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") "
Oct 30 22:17:42.656536 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.656374    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16b60c3f-f905-4e66-a401-dfa2554f803f-kube-api-access-psjtq\" (UniqueName: \"kubernetes.io/projected/16b60c3f-f905-4e66-a401-dfa2554f803f-kube-api-access-psjtq\") pod \"16b60c3f-f905-4e66-a401-dfa2554f803f\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") "
Oct 30 22:17:42.656578 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.656538    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-xks-ca\") pod \"16b60c3f-f905-4e66-a401-dfa2554f803f\" (UID: \"16b60c3f-f905-4e66-a401-dfa2554f803f\") "
Oct 30 22:17:42.656750 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.656728    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-openshift-ca" pod "16b60c3f-f905-4e66-a401-dfa2554f803f" (UID: "16b60c3f-f905-4e66-a401-dfa2554f803f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:42.656893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.656878    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.658715 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.658690    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-xks-ca" pod "16b60c3f-f905-4e66-a401-dfa2554f803f" (UID: "16b60c3f-f905-4e66-a401-dfa2554f803f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:17:42.658822 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.658713    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b60c3f-f905-4e66-a401-dfa2554f803f-kube-api-access-psjtq" pod "16b60c3f-f905-4e66-a401-dfa2554f803f" (UID: "16b60c3f-f905-4e66-a401-dfa2554f803f"). InnerVolumeSpecName "kube-api-access-psjtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:42.757995 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.757954    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psjtq\" (UniqueName: \"kubernetes.io/projected/16b60c3f-f905-4e66-a401-dfa2554f803f-kube-api-access-psjtq\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.757995 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:42.757994    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b60c3f-f905-4e66-a401-dfa2554f803f-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:43.338412 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:43.338383    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"
Oct 30 22:17:43.338556 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:43.338410    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx" event={"ID":"16b60c3f-f905-4e66-a401-dfa2554f803f","Type":"ContainerDied","Data":"eb2358f59c394b3b4235138cb7b433b3861268f641b7b4d8552e63a2999ad466"}
Oct 30 22:17:43.338556 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:43.338456    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb2358f59c394b3b4235138cb7b433b3861268f641b7b4d8552e63a2999ad466"
Oct 30 22:17:53.608247 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:17:53.608200    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:17:59.899028 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:17:59.898991    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:14.111277 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.111242    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"]
Oct 30 22:18:14.111915 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.111894    5575 cpu_manager.go:414] "containerMap: removing container" podUID="16b60c3f-f905-4e66-a401-dfa2554f803f" containerName="revoke-keys"
Oct 30 22:18:14.112016 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.111919    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16b60c3f-f905-4e66-a401-dfa2554f803f" containerName="revoke-keys"
Oct 30 22:18:14.112127 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.112113    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="16b60c3f-f905-4e66-a401-dfa2554f803f" containerName="revoke-keys"
Oct 30 22:18:14.115403 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.115383    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.173717 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.173689    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"]
Oct 30 22:18:14.219688 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.219646    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:18:14.219827 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.219705    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:18:14.271253 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.271224    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-kcsnd\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.271409 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.271389    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-kcsnd\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.271455 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.271437    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfqgd\" (UniqueName: \"kubernetes.io/projected/fcca32ea-f6b9-4430-b025-d00fe53b93ac-kube-api-access-zfqgd\") pod \"maas-api-revoke-sub-ae594979-kcsnd\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.372435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.372372    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-kcsnd\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.372435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.372424    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-kcsnd\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.372586 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.372452    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfqgd\" (UniqueName: \"kubernetes.io/projected/fcca32ea-f6b9-4430-b025-d00fe53b93ac-kube-api-access-zfqgd\") pod \"maas-api-revoke-sub-ae594979-kcsnd\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.373113 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.373094    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-kcsnd\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.374836 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.374810    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-kcsnd\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.434152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.434127    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfqgd\" (UniqueName: \"kubernetes.io/projected/fcca32ea-f6b9-4430-b025-d00fe53b93ac-kube-api-access-zfqgd\") pod \"maas-api-revoke-sub-ae594979-kcsnd\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:14.503621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.503590    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:14.728677 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:14.728646    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:15.105841 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:15.105810    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"]
Oct 30 22:18:15.106758 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:18:15.106729    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcca32ea_f6b9_4430_b025_d00fe53b93ac.slice/crio-15e4898f306f3664a742080befd53de0997a4e4a6340ce9b2870ae05dd2eadaf WatchSource:0}: Error finding container 15e4898f306f3664a742080befd53de0997a4e4a6340ce9b2870ae05dd2eadaf: Status 404 returned error can't find the container with id 15e4898f306f3664a742080befd53de0997a4e4a6340ce9b2870ae05dd2eadaf
Oct 30 22:18:15.593242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:15.593206    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd" event={"ID":"fcca32ea-f6b9-4430-b025-d00fe53b93ac","Type":"ContainerStarted","Data":"ba6012923b767d3243f3c6503b766e4b4fa9e1037ebf0a4a223ab36a3d9b55fb"}
Oct 30 22:18:15.593607 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:15.593265    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd" event={"ID":"fcca32ea-f6b9-4430-b025-d00fe53b93ac","Type":"ContainerStarted","Data":"15e4898f306f3664a742080befd53de0997a4e4a6340ce9b2870ae05dd2eadaf"}
Oct 30 22:18:15.711793 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:15.711717    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd" podStartSLOduration=1.711705687 podStartE2EDuration="1.711705687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:15.709291139 +0000 UTC m=+3296.741139688" watchObservedRunningTime="2026-10-30 22:18:15.711705687 +0000 UTC m=+3296.743554223"
Oct 30 22:18:16.139240 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:16.139211    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:16.600621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:16.600582    5575 generic.go:356] "Generic (PLEG): container finished" podID="fcca32ea-f6b9-4430-b025-d00fe53b93ac" containerID="ba6012923b767d3243f3c6503b766e4b4fa9e1037ebf0a4a223ab36a3d9b55fb" exitCode=0
Oct 30 22:18:16.601019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:16.600635    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd" event={"ID":"fcca32ea-f6b9-4430-b025-d00fe53b93ac","Type":"ContainerDied","Data":"ba6012923b767d3243f3c6503b766e4b4fa9e1037ebf0a4a223ab36a3d9b55fb"}
Oct 30 22:18:17.752840 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:17.752814    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:17.904201 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:17.904169    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-openshift-ca\") pod \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") "
Oct 30 22:18:17.904363 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:17.904222    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-xks-ca\") pod \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") "
Oct 30 22:18:17.904443 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:17.904380    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fcca32ea-f6b9-4430-b025-d00fe53b93ac-kube-api-access-zfqgd\" (UniqueName: \"kubernetes.io/projected/fcca32ea-f6b9-4430-b025-d00fe53b93ac-kube-api-access-zfqgd\") pod \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\" (UID: \"fcca32ea-f6b9-4430-b025-d00fe53b93ac\") "
Oct 30 22:18:17.904555 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:17.904530    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-openshift-ca" pod "fcca32ea-f6b9-4430-b025-d00fe53b93ac" (UID: "fcca32ea-f6b9-4430-b025-d00fe53b93ac"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:17.904741 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:17.904720    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:17.906423 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:17.906401    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-xks-ca" pod "fcca32ea-f6b9-4430-b025-d00fe53b93ac" (UID: "fcca32ea-f6b9-4430-b025-d00fe53b93ac"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:18:17.906593 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:17.906574    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcca32ea-f6b9-4430-b025-d00fe53b93ac-kube-api-access-zfqgd" pod "fcca32ea-f6b9-4430-b025-d00fe53b93ac" (UID: "fcca32ea-f6b9-4430-b025-d00fe53b93ac"). InnerVolumeSpecName "kube-api-access-zfqgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:18.005737 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:18.005715    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fcca32ea-f6b9-4430-b025-d00fe53b93ac-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:18.005737 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:18.005736    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfqgd\" (UniqueName: \"kubernetes.io/projected/fcca32ea-f6b9-4430-b025-d00fe53b93ac-kube-api-access-zfqgd\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:18.613852 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:18.613824    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"
Oct 30 22:18:18.614045 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:18.613820    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd" event={"ID":"fcca32ea-f6b9-4430-b025-d00fe53b93ac","Type":"ContainerDied","Data":"15e4898f306f3664a742080befd53de0997a4e4a6340ce9b2870ae05dd2eadaf"}
Oct 30 22:18:18.614045 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:18.613950    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15e4898f306f3664a742080befd53de0997a4e4a6340ce9b2870ae05dd2eadaf"
Oct 30 22:18:19.798753 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:19.798725    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:18:19.813592 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:19.813569    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:18:19.820616 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:19.820589    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:18:19.834942 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:19.834926    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:18:23.485135 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:18:23.485098    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:18:31.053649 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:31.053604    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"]
Oct 30 22:18:31.103441 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:31.103410    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-023a7645-cwbhd"]
Oct 30 22:18:31.127740 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:31.127707    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b84bff1-6d77-4323-b2ce-f40c7454a08e" path="/var/lib/kubelet/pods/3b84bff1-6d77-4323-b2ce-f40c7454a08e/volumes"
Oct 30 22:18:42.335975 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.335940    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"]
Oct 30 22:18:42.336449 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.336383    5575 cpu_manager.go:414] "containerMap: removing container" podUID="fcca32ea-f6b9-4430-b025-d00fe53b93ac" containerName="revoke-keys"
Oct 30 22:18:42.336449 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.336395    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fcca32ea-f6b9-4430-b025-d00fe53b93ac" containerName="revoke-keys"
Oct 30 22:18:42.336571 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.336487    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="fcca32ea-f6b9-4430-b025-d00fe53b93ac" containerName="revoke-keys"
Oct 30 22:18:42.339514 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.339490    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.396216 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.396171    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:18:42.446126 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.446099    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:18:42.449262 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.449239    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"]
Oct 30 22:18:42.499873 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.499838    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrh7q\" (UniqueName: \"kubernetes.io/projected/9bf1662d-6afa-4ad5-b688-4c20fac85d55-kube-api-access-zrh7q\") pod \"maas-api-revoke-sub-a4aef7d7-nvhdj\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.500032 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.499878    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nvhdj\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.500032 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.499957    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nvhdj\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.601240 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.601167    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrh7q\" (UniqueName: \"kubernetes.io/projected/9bf1662d-6afa-4ad5-b688-4c20fac85d55-kube-api-access-zrh7q\") pod \"maas-api-revoke-sub-a4aef7d7-nvhdj\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.601240 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.601198    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nvhdj\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.601240 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.601225    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nvhdj\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.601795 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.601778    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nvhdj\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.603657 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.603632    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nvhdj\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.662202 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.662173    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrh7q\" (UniqueName: \"kubernetes.io/projected/9bf1662d-6afa-4ad5-b688-4c20fac85d55-kube-api-access-zrh7q\") pod \"maas-api-revoke-sub-a4aef7d7-nvhdj\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:42.953205 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:42.953170    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:43.335730 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:43.335698    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"]
Oct 30 22:18:43.336304 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:18:43.336273    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf1662d_6afa_4ad5_b688_4c20fac85d55.slice/crio-6b9620f140696fea6dc454dac5172043cfa64d7d34424565073de61521303141 WatchSource:0}: Error finding container 6b9620f140696fea6dc454dac5172043cfa64d7d34424565073de61521303141: Status 404 returned error can't find the container with id 6b9620f140696fea6dc454dac5172043cfa64d7d34424565073de61521303141
Oct 30 22:18:43.869620 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:43.869526    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj" event={"ID":"9bf1662d-6afa-4ad5-b688-4c20fac85d55","Type":"ContainerStarted","Data":"72af265aa65d1c969632c0f856ad1a738cbc899dcf01d3bfaffc3e15f624572c"}
Oct 30 22:18:43.869620 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:43.869604    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj" event={"ID":"9bf1662d-6afa-4ad5-b688-4c20fac85d55","Type":"ContainerStarted","Data":"6b9620f140696fea6dc454dac5172043cfa64d7d34424565073de61521303141"}
Oct 30 22:18:44.877378 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:44.877339    5575 generic.go:356] "Generic (PLEG): container finished" podID="9bf1662d-6afa-4ad5-b688-4c20fac85d55" containerID="72af265aa65d1c969632c0f856ad1a738cbc899dcf01d3bfaffc3e15f624572c" exitCode=0
Oct 30 22:18:44.877775 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:44.877453    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj" event={"ID":"9bf1662d-6afa-4ad5-b688-4c20fac85d55","Type":"ContainerDied","Data":"72af265aa65d1c969632c0f856ad1a738cbc899dcf01d3bfaffc3e15f624572c"}
Oct 30 22:18:46.026238 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.026213    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:46.042116 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.042084    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-xks-ca\") pod \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") "
Oct 30 22:18:46.042206 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.042162    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9bf1662d-6afa-4ad5-b688-4c20fac85d55-kube-api-access-zrh7q\" (UniqueName: \"kubernetes.io/projected/9bf1662d-6afa-4ad5-b688-4c20fac85d55-kube-api-access-zrh7q\") pod \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") "
Oct 30 22:18:46.042257 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.042246    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-openshift-ca\") pod \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\" (UID: \"9bf1662d-6afa-4ad5-b688-4c20fac85d55\") "
Oct 30 22:18:46.042559 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.042538    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-openshift-ca" pod "9bf1662d-6afa-4ad5-b688-4c20fac85d55" (UID: "9bf1662d-6afa-4ad5-b688-4c20fac85d55"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:46.044359 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.044337    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-xks-ca" pod "9bf1662d-6afa-4ad5-b688-4c20fac85d55" (UID: "9bf1662d-6afa-4ad5-b688-4c20fac85d55"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:18:46.044359 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.044348    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf1662d-6afa-4ad5-b688-4c20fac85d55-kube-api-access-zrh7q" pod "9bf1662d-6afa-4ad5-b688-4c20fac85d55" (UID: "9bf1662d-6afa-4ad5-b688-4c20fac85d55"). InnerVolumeSpecName "kube-api-access-zrh7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:46.143674 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.143595    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrh7q\" (UniqueName: \"kubernetes.io/projected/9bf1662d-6afa-4ad5-b688-4c20fac85d55-kube-api-access-zrh7q\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:46.143674 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.143621    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:46.143674 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.143636    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bf1662d-6afa-4ad5-b688-4c20fac85d55-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:46.890855 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.890824    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"
Oct 30 22:18:46.890855 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.890831    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj" event={"ID":"9bf1662d-6afa-4ad5-b688-4c20fac85d55","Type":"ContainerDied","Data":"6b9620f140696fea6dc454dac5172043cfa64d7d34424565073de61521303141"}
Oct 30 22:18:46.891094 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:46.890873    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b9620f140696fea6dc454dac5172043cfa64d7d34424565073de61521303141"
Oct 30 22:18:53.485732 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:18:53.485694    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:18:54.847243 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:54.847210    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:59.771825 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:18:59.771750    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:00.000571 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:00.000528    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:00.249397 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:00.249362    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:00.416226 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:00.416194    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:06.579341 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:06.579307    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:23.095647 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.095611    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"]
Oct 30 22:19:23.096196 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.096124    5575 cpu_manager.go:414] "containerMap: removing container" podUID="9bf1662d-6afa-4ad5-b688-4c20fac85d55" containerName="revoke-keys"
Oct 30 22:19:23.096196 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.096136    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9bf1662d-6afa-4ad5-b688-4c20fac85d55" containerName="revoke-keys"
Oct 30 22:19:23.096349 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.096208    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="9bf1662d-6afa-4ad5-b688-4c20fac85d55" containerName="revoke-keys"
Oct 30 22:19:23.099451 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.099424    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.158371 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.158338    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"]
Oct 30 22:19:23.204349 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.204317    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:19:23.204349 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.204353    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:19:23.246224 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.246194    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rj7t\" (UniqueName: \"kubernetes.io/projected/636e24e6-d524-4940-bb5a-a98892da998e-kube-api-access-6rj7t\") pod \"maas-api-revoke-sub-79805ca9-hgr4t\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.246224 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.246225    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-hgr4t\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.246456 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.246433    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-hgr4t\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.348106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.348034    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-hgr4t\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.348106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.348098    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rj7t\" (UniqueName: \"kubernetes.io/projected/636e24e6-d524-4940-bb5a-a98892da998e-kube-api-access-6rj7t\") pod \"maas-api-revoke-sub-79805ca9-hgr4t\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.348286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.348117    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-hgr4t\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.348780 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.348760    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-hgr4t\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.350569 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.350547    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-hgr4t\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.409284 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.409257    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rj7t\" (UniqueName: \"kubernetes.io/projected/636e24e6-d524-4940-bb5a-a98892da998e-kube-api-access-6rj7t\") pod \"maas-api-revoke-sub-79805ca9-hgr4t\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.411860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.411834    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:23.495441 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:19:23.495383    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:19:23.787309 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:23.787281    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"]
Oct 30 22:19:23.788921 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:19:23.788888    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636e24e6_d524_4940_bb5a_a98892da998e.slice/crio-23817d9bbfd0763ea1cd4c6ff8ae47c1f4a7efb5c752a3390bf1018189e602cb WatchSource:0}: Error finding container 23817d9bbfd0763ea1cd4c6ff8ae47c1f4a7efb5c752a3390bf1018189e602cb: Status 404 returned error can't find the container with id 23817d9bbfd0763ea1cd4c6ff8ae47c1f4a7efb5c752a3390bf1018189e602cb
Oct 30 22:19:24.160816 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:24.160771    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t" event={"ID":"636e24e6-d524-4940-bb5a-a98892da998e","Type":"ContainerStarted","Data":"6befda5993f7592748fc2b5d2017abfbbc4adf66c72392b89b93a6f9ee12b6d9"}
Oct 30 22:19:24.161209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:24.160838    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t" event={"ID":"636e24e6-d524-4940-bb5a-a98892da998e","Type":"ContainerStarted","Data":"23817d9bbfd0763ea1cd4c6ff8ae47c1f4a7efb5c752a3390bf1018189e602cb"}
Oct 30 22:19:24.278391 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:24.278343    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t" podStartSLOduration=1.278330832 podStartE2EDuration="1.278330832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:24.27628523 +0000 UTC m=+3365.308133766" watchObservedRunningTime="2026-10-30 22:19:24.278330832 +0000 UTC m=+3365.310179411"
Oct 30 22:19:25.167591 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:25.167561    5575 generic.go:356] "Generic (PLEG): container finished" podID="636e24e6-d524-4940-bb5a-a98892da998e" containerID="6befda5993f7592748fc2b5d2017abfbbc4adf66c72392b89b93a6f9ee12b6d9" exitCode=0
Oct 30 22:19:25.168035 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:25.167626    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t" event={"ID":"636e24e6-d524-4940-bb5a-a98892da998e","Type":"ContainerDied","Data":"6befda5993f7592748fc2b5d2017abfbbc4adf66c72392b89b93a6f9ee12b6d9"}
Oct 30 22:19:26.332948 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.332923    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:26.475537 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.475467    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/636e24e6-d524-4940-bb5a-a98892da998e-kube-api-access-6rj7t\" (UniqueName: \"kubernetes.io/projected/636e24e6-d524-4940-bb5a-a98892da998e-kube-api-access-6rj7t\") pod \"636e24e6-d524-4940-bb5a-a98892da998e\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") "
Oct 30 22:19:26.475669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.475535    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-xks-ca\") pod \"636e24e6-d524-4940-bb5a-a98892da998e\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") "
Oct 30 22:19:26.475669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.475647    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-openshift-ca\") pod \"636e24e6-d524-4940-bb5a-a98892da998e\" (UID: \"636e24e6-d524-4940-bb5a-a98892da998e\") "
Oct 30 22:19:26.476096 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.476064    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-openshift-ca" pod "636e24e6-d524-4940-bb5a-a98892da998e" (UID: "636e24e6-d524-4940-bb5a-a98892da998e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:19:26.478464 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.478436    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-xks-ca" pod "636e24e6-d524-4940-bb5a-a98892da998e" (UID: "636e24e6-d524-4940-bb5a-a98892da998e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:19:26.478616 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.478591    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636e24e6-d524-4940-bb5a-a98892da998e-kube-api-access-6rj7t" pod "636e24e6-d524-4940-bb5a-a98892da998e" (UID: "636e24e6-d524-4940-bb5a-a98892da998e"). InnerVolumeSpecName "kube-api-access-6rj7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:26.576658 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.576632    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:26.576658 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.576657    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rj7t\" (UniqueName: \"kubernetes.io/projected/636e24e6-d524-4940-bb5a-a98892da998e-kube-api-access-6rj7t\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:26.576816 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:26.576667    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/636e24e6-d524-4940-bb5a-a98892da998e-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:27.181470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:27.181441    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"
Oct 30 22:19:27.181638 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:27.181473    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t" event={"ID":"636e24e6-d524-4940-bb5a-a98892da998e","Type":"ContainerDied","Data":"23817d9bbfd0763ea1cd4c6ff8ae47c1f4a7efb5c752a3390bf1018189e602cb"}
Oct 30 22:19:27.181638 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:27.181522    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23817d9bbfd0763ea1cd4c6ff8ae47c1f4a7efb5c752a3390bf1018189e602cb"
Oct 30 22:19:40.769990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:40.769348    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-rmjwj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.159:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:19:40.769990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:40.769427    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.159:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:19:43.049458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:43.049426    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"]
Oct 30 22:19:43.099388 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:43.099350    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8hg5x"]
Oct 30 22:19:43.126978 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:43.126932    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2cef76a-3f9c-41b2-a8c8-92139e53ecb6" path="/var/lib/kubelet/pods/b2cef76a-3f9c-41b2-a8c8-92139e53ecb6/volumes"
Oct 30 22:19:47.035781 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.035748    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"]
Oct 30 22:19:47.036268 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.036176    5575 cpu_manager.go:414] "containerMap: removing container" podUID="636e24e6-d524-4940-bb5a-a98892da998e" containerName="revoke-keys"
Oct 30 22:19:47.036268 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.036187    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="636e24e6-d524-4940-bb5a-a98892da998e" containerName="revoke-keys"
Oct 30 22:19:47.036344 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.036291    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="636e24e6-d524-4940-bb5a-a98892da998e" containerName="revoke-keys"
Oct 30 22:19:47.040505 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.040488    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.094082 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.094051    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:19:47.143782 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.143757    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:19:47.146662 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.146638    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"]
Oct 30 22:19:47.146978 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.146949    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk5xc\" (UniqueName: \"kubernetes.io/projected/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-kube-api-access-mk5xc\") pod \"maas-api-revoke-sub-0b7e8edb-rzttj\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.147028 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.147006    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-rzttj\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.147134 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.147118    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-rzttj\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.248458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.248432    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-rzttj\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.248599 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.248485    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-rzttj\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.248599 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.248546    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk5xc\" (UniqueName: \"kubernetes.io/projected/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-kube-api-access-mk5xc\") pod \"maas-api-revoke-sub-0b7e8edb-rzttj\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.249153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.249130    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-rzttj\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.251100 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.251083    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-rzttj\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.317136 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.317068    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk5xc\" (UniqueName: \"kubernetes.io/projected/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-kube-api-access-mk5xc\") pod \"maas-api-revoke-sub-0b7e8edb-rzttj\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.353547 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.353523    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:47.731022 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:47.730998    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"]
Oct 30 22:19:47.731289 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:19:47.731267    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec8bfb3_7ce0_45c0_a48b_d8c09d66859d.slice/crio-0058e702d3b273a4c41d8a236ef37c0505e88bce6d1008597e659160a0e1a7d7 WatchSource:0}: Error finding container 0058e702d3b273a4c41d8a236ef37c0505e88bce6d1008597e659160a0e1a7d7: Status 404 returned error can't find the container with id 0058e702d3b273a4c41d8a236ef37c0505e88bce6d1008597e659160a0e1a7d7
Oct 30 22:19:48.360484 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:48.360401    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj" event={"ID":"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d","Type":"ContainerStarted","Data":"575e1981f61f074d704c4d6cd1f5cea9e3e117779e4dc45b31ada0aae8c57a38"}
Oct 30 22:19:48.360484 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:48.360458    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj" event={"ID":"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d","Type":"ContainerStarted","Data":"0058e702d3b273a4c41d8a236ef37c0505e88bce6d1008597e659160a0e1a7d7"}
Oct 30 22:19:48.478489 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:48.478444    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj" podStartSLOduration=2.478432182 podStartE2EDuration="2.478432182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:48.477141051 +0000 UTC m=+3389.508989597" watchObservedRunningTime="2026-10-30 22:19:48.478432182 +0000 UTC m=+3389.510280749"
Oct 30 22:19:49.367596 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:49.367563    5575 generic.go:356] "Generic (PLEG): container finished" podID="1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d" containerID="575e1981f61f074d704c4d6cd1f5cea9e3e117779e4dc45b31ada0aae8c57a38" exitCode=0
Oct 30 22:19:49.368002 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:49.367610    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj" event={"ID":"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d","Type":"ContainerDied","Data":"575e1981f61f074d704c4d6cd1f5cea9e3e117779e4dc45b31ada0aae8c57a38"}
Oct 30 22:19:50.517740 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.517715    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:50.577929 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.577903    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-xks-ca\") pod \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") "
Oct 30 22:19:50.578061 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.578016    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-openshift-ca\") pod \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") "
Oct 30 22:19:50.578141 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.578126    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-kube-api-access-mk5xc\" (UniqueName: \"kubernetes.io/projected/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-kube-api-access-mk5xc\") pod \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\" (UID: \"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d\") "
Oct 30 22:19:50.578382 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.578356    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-openshift-ca" pod "1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d" (UID: "1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:19:50.578459 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.578443    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.580131 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.580108    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-xks-ca" pod "1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d" (UID: "1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:19:50.580466 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.580439    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-kube-api-access-mk5xc" pod "1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d" (UID: "1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d"). InnerVolumeSpecName "kube-api-access-mk5xc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:50.679928 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.679891    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk5xc\" (UniqueName: \"kubernetes.io/projected/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-kube-api-access-mk5xc\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.679928 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:50.679924    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:51.382128 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:51.382096    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj" event={"ID":"1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d","Type":"ContainerDied","Data":"0058e702d3b273a4c41d8a236ef37c0505e88bce6d1008597e659160a0e1a7d7"}
Oct 30 22:19:51.382307 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:51.382145    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0058e702d3b273a4c41d8a236ef37c0505e88bce6d1008597e659160a0e1a7d7"
Oct 30 22:19:51.382307 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:51.382111    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"
Oct 30 22:19:53.485873 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:19:53.485840    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:19:58.453527 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.453486    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"]
Oct 30 22:19:58.454040 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.454024    5575 cpu_manager.go:414] "containerMap: removing container" podUID="1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d" containerName="revoke-keys"
Oct 30 22:19:58.454040 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.454041    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d" containerName="revoke-keys"
Oct 30 22:19:58.454153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.454132    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d" containerName="revoke-keys"
Oct 30 22:19:58.457421 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.457403    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.515149 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.514999    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"]
Oct 30 22:19:58.555908 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.555881    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-nlrwf\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.556091 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.555933    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-nlrwf\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.556091 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.556054    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dx9l\" (UniqueName: \"kubernetes.io/projected/566523af-68b9-4330-bca3-9a415d5e38ab-kube-api-access-6dx9l\") pod \"maas-api-revoke-sub-3d4156f1-nlrwf\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.560997 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.560950    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:19:58.561107 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.561049    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:19:58.657458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.657429    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-nlrwf\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.657598 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.657476    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dx9l\" (UniqueName: \"kubernetes.io/projected/566523af-68b9-4330-bca3-9a415d5e38ab-kube-api-access-6dx9l\") pod \"maas-api-revoke-sub-3d4156f1-nlrwf\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.657651 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.657608    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-nlrwf\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.658209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.658186    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-nlrwf\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.660142 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.660122    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-nlrwf\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.718657 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.718602    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dx9l\" (UniqueName: \"kubernetes.io/projected/566523af-68b9-4330-bca3-9a415d5e38ab-kube-api-access-6dx9l\") pod \"maas-api-revoke-sub-3d4156f1-nlrwf\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:58.770387 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:58.770365    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:19:59.143454 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:59.143425    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"]
Oct 30 22:19:59.144772 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:19:59.144752    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566523af_68b9_4330_bca3_9a415d5e38ab.slice/crio-c4b913a1be40ffa1375961265032034e4053d9530801ce557679b4d2c6377b27 WatchSource:0}: Error finding container c4b913a1be40ffa1375961265032034e4053d9530801ce557679b4d2c6377b27: Status 404 returned error can't find the container with id c4b913a1be40ffa1375961265032034e4053d9530801ce557679b4d2c6377b27
Oct 30 22:19:59.437269 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:59.437234    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf" event={"ID":"566523af-68b9-4330-bca3-9a415d5e38ab","Type":"ContainerStarted","Data":"fb25dcc2db7edd2c8520b1aaf91317d2413c7f9ba30a39430fb4efc1c3b32e85"}
Oct 30 22:19:59.437468 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:59.437320    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf" event={"ID":"566523af-68b9-4330-bca3-9a415d5e38ab","Type":"ContainerStarted","Data":"c4b913a1be40ffa1375961265032034e4053d9530801ce557679b4d2c6377b27"}
Oct 30 22:19:59.555506 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:19:59.555445    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf" podStartSLOduration=1.5554316990000001 podStartE2EDuration="1.555431699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:59.553582036 +0000 UTC m=+3400.585430563" watchObservedRunningTime="2026-10-30 22:19:59.555431699 +0000 UTC m=+3400.587280234"
Oct 30 22:20:00.445862 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:00.445823    5575 generic.go:356] "Generic (PLEG): container finished" podID="566523af-68b9-4330-bca3-9a415d5e38ab" containerID="fb25dcc2db7edd2c8520b1aaf91317d2413c7f9ba30a39430fb4efc1c3b32e85" exitCode=0
Oct 30 22:20:00.446096 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:00.446047    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf" event={"ID":"566523af-68b9-4330-bca3-9a415d5e38ab","Type":"ContainerDied","Data":"fb25dcc2db7edd2c8520b1aaf91317d2413c7f9ba30a39430fb4efc1c3b32e85"}
Oct 30 22:20:00.604653 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:00.604501    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:02.390001 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.388469    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:20:02.495385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.495338    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf" event={"ID":"566523af-68b9-4330-bca3-9a415d5e38ab","Type":"ContainerDied","Data":"c4b913a1be40ffa1375961265032034e4053d9530801ce557679b4d2c6377b27"}
Oct 30 22:20:02.495590 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.495401    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4b913a1be40ffa1375961265032034e4053d9530801ce557679b4d2c6377b27"
Oct 30 22:20:02.495590 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.495475    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"
Oct 30 22:20:02.501287 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.501257    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-openshift-ca\") pod \"566523af-68b9-4330-bca3-9a415d5e38ab\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") "
Oct 30 22:20:02.501428 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.501375    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-xks-ca\") pod \"566523af-68b9-4330-bca3-9a415d5e38ab\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") "
Oct 30 22:20:02.501510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.501486    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/566523af-68b9-4330-bca3-9a415d5e38ab-kube-api-access-6dx9l\" (UniqueName: \"kubernetes.io/projected/566523af-68b9-4330-bca3-9a415d5e38ab-kube-api-access-6dx9l\") pod \"566523af-68b9-4330-bca3-9a415d5e38ab\" (UID: \"566523af-68b9-4330-bca3-9a415d5e38ab\") "
Oct 30 22:20:02.501741 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.501696    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-openshift-ca" pod "566523af-68b9-4330-bca3-9a415d5e38ab" (UID: "566523af-68b9-4330-bca3-9a415d5e38ab"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:20:02.502271 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.502249    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:02.504278 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.504250    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-xks-ca" pod "566523af-68b9-4330-bca3-9a415d5e38ab" (UID: "566523af-68b9-4330-bca3-9a415d5e38ab"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:20:02.504389 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.504357    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566523af-68b9-4330-bca3-9a415d5e38ab-kube-api-access-6dx9l" pod "566523af-68b9-4330-bca3-9a415d5e38ab" (UID: "566523af-68b9-4330-bca3-9a415d5e38ab"). InnerVolumeSpecName "kube-api-access-6dx9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:20:02.603046 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.602935    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/566523af-68b9-4330-bca3-9a415d5e38ab-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:02.603046 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:02.602993    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dx9l\" (UniqueName: \"kubernetes.io/projected/566523af-68b9-4330-bca3-9a415d5e38ab-kube-api-access-6dx9l\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:20.652332 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:20.652298    5575 scope.go:122] "RemoveContainer" containerID="87ac505dbe57fae5a07cf34f96f1c7cc5502db0cb3e41c844800b5a3263b316e"
Oct 30 22:20:23.486243 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:20:23.486204    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:20:39.775039 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.775007    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"]
Oct 30 22:20:39.824650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.824620    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-nlrwf"]
Oct 30 22:20:39.887303 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.887269    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"]
Oct 30 22:20:39.887793 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.887778    5575 cpu_manager.go:414] "containerMap: removing container" podUID="566523af-68b9-4330-bca3-9a415d5e38ab" containerName="revoke-keys"
Oct 30 22:20:39.887838 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.887795    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="566523af-68b9-4330-bca3-9a415d5e38ab" containerName="revoke-keys"
Oct 30 22:20:39.887874 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.887864    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="566523af-68b9-4330-bca3-9a415d5e38ab" containerName="revoke-keys"
Oct 30 22:20:39.891103 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.891086    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:39.913181 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.913157    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-bv27w\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:39.913288 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.913238    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vdw8\" (UniqueName: \"kubernetes.io/projected/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-kube-api-access-5vdw8\") pod \"maas-api-revoke-sub-3d4156f1-bv27w\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:39.913346 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.913331    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-bv27w\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:39.945825 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.945801    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:20:39.946012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.945957    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:20:39.949678 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:39.949657    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"]
Oct 30 22:20:40.014376 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:40.014344    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-bv27w\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:40.014504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:40.014384    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdw8\" (UniqueName: \"kubernetes.io/projected/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-kube-api-access-5vdw8\") pod \"maas-api-revoke-sub-3d4156f1-bv27w\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:40.014504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:40.014438    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-bv27w\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:40.015098 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:40.015080    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-bv27w\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:40.016899 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:40.016875    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-bv27w\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:40.076022 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:40.075946    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vdw8\" (UniqueName: \"kubernetes.io/projected/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-kube-api-access-5vdw8\") pod \"maas-api-revoke-sub-3d4156f1-bv27w\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:40.204010 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:40.203984    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:40.579901 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:40.579872    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"]
Oct 30 22:20:40.581320 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:20:40.581295    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9e0cad_5c1d_44f1_bcb5_cfb075372524.slice/crio-19feeecf9bc2b40485efbd31521c354b30ff4885b05465d25ea259b39f6d0bd1 WatchSource:0}: Error finding container 19feeecf9bc2b40485efbd31521c354b30ff4885b05465d25ea259b39f6d0bd1: Status 404 returned error can't find the container with id 19feeecf9bc2b40485efbd31521c354b30ff4885b05465d25ea259b39f6d0bd1
Oct 30 22:20:40.789568 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:40.789534    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w" event={"ID":"7f9e0cad-5c1d-44f1-bcb5-cfb075372524","Type":"ContainerStarted","Data":"19feeecf9bc2b40485efbd31521c354b30ff4885b05465d25ea259b39f6d0bd1"}
Oct 30 22:20:41.130001 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:41.129956    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="566523af-68b9-4330-bca3-9a415d5e38ab" path="/var/lib/kubelet/pods/566523af-68b9-4330-bca3-9a415d5e38ab/volumes"
Oct 30 22:20:41.797364 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:41.797326    5575 generic.go:356] "Generic (PLEG): container finished" podID="7f9e0cad-5c1d-44f1-bcb5-cfb075372524" containerID="31e72e3646262a1895b785b39014a59c19c9d346eb880e0956aefa3773e9a82b" exitCode=0
Oct 30 22:20:41.797806 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:41.797384    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w" event={"ID":"7f9e0cad-5c1d-44f1-bcb5-cfb075372524","Type":"ContainerDied","Data":"31e72e3646262a1895b785b39014a59c19c9d346eb880e0956aefa3773e9a82b"}
Oct 30 22:20:42.935716 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:42.935688    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:43.035759 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.035731    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-kube-api-access-5vdw8\" (UniqueName: \"kubernetes.io/projected/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-kube-api-access-5vdw8\") pod \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") "
Oct 30 22:20:43.035930 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.035793    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-openshift-ca\") pod \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") "
Oct 30 22:20:43.035930 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.035844    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-xks-ca\") pod \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\" (UID: \"7f9e0cad-5c1d-44f1-bcb5-cfb075372524\") "
Oct 30 22:20:43.036109 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.036088    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-openshift-ca" pod "7f9e0cad-5c1d-44f1-bcb5-cfb075372524" (UID: "7f9e0cad-5c1d-44f1-bcb5-cfb075372524"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:20:43.036246 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.036224    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:43.037937 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.037917    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-xks-ca" pod "7f9e0cad-5c1d-44f1-bcb5-cfb075372524" (UID: "7f9e0cad-5c1d-44f1-bcb5-cfb075372524"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:20:43.037937 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.037924    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-kube-api-access-5vdw8" pod "7f9e0cad-5c1d-44f1-bcb5-cfb075372524" (UID: "7f9e0cad-5c1d-44f1-bcb5-cfb075372524"). InnerVolumeSpecName "kube-api-access-5vdw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:20:43.137071 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.137049    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:43.137071 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.137071    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vdw8\" (UniqueName: \"kubernetes.io/projected/7f9e0cad-5c1d-44f1-bcb5-cfb075372524-kube-api-access-5vdw8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:43.811191 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.811162    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"
Oct 30 22:20:43.811342 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.811201    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w" event={"ID":"7f9e0cad-5c1d-44f1-bcb5-cfb075372524","Type":"ContainerDied","Data":"19feeecf9bc2b40485efbd31521c354b30ff4885b05465d25ea259b39f6d0bd1"}
Oct 30 22:20:43.811342 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:43.811249    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19feeecf9bc2b40485efbd31521c354b30ff4885b05465d25ea259b39f6d0bd1"
Oct 30 22:20:52.049980 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:52.049934    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"]
Oct 30 22:20:52.100012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:52.099948    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-dxkz6"]
Oct 30 22:20:53.125348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:20:53.125309    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59c33158-ae72-41bd-8a90-c443d6f584aa" path="/var/lib/kubelet/pods/59c33158-ae72-41bd-8a90-c443d6f584aa/volumes"
Oct 30 22:20:53.488404 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:20:53.488370    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:21:00.959029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:00.958998    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:20.678578 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:20.678453    5575 scope.go:122] "RemoveContainer" containerID="3dfffc664ece91c3c1579838adbdeb8f9032ee4555afa68515b4022ddfc61e3b"
Oct 30 22:21:23.049800 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:23.049763    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"]
Oct 30 22:21:23.099252 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:23.099194    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-cr8rb"]
Oct 30 22:21:23.135573 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:23.135533    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a732d2fc-58c6-410f-aae1-cbfcab1d220f" path="/var/lib/kubelet/pods/a732d2fc-58c6-410f-aae1-cbfcab1d220f/volumes"
Oct 30 22:21:23.486950 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:21:23.486917    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:21:35.051801 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:35.051695    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"]
Oct 30 22:21:35.101178 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:35.101145    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-78rwg"]
Oct 30 22:21:35.125644 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:35.125620    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a261cd9-c03f-419c-9851-a9016aa792b3" path="/var/lib/kubelet/pods/3a261cd9-c03f-419c-9851-a9016aa792b3/volumes"
Oct 30 22:21:47.596019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.595990    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"]
Oct 30 22:21:47.596562 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.596543    5575 cpu_manager.go:414] "containerMap: removing container" podUID="7f9e0cad-5c1d-44f1-bcb5-cfb075372524" containerName="revoke-keys"
Oct 30 22:21:47.596622 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.596564    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f9e0cad-5c1d-44f1-bcb5-cfb075372524" containerName="revoke-keys"
Oct 30 22:21:47.596671 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.596661    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f9e0cad-5c1d-44f1-bcb5-cfb075372524" containerName="revoke-keys"
Oct 30 22:21:47.600082 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.600067    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.650434 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.650410    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-69w5k\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.650553 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.650536    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpfd6\" (UniqueName: \"kubernetes.io/projected/b5e94810-cde2-458c-934a-be139bafcabe-kube-api-access-qpfd6\") pod \"maas-api-revoke-sub-e2fc9c5b-69w5k\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.650597 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.650570    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-69w5k\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.657665 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.657643    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"]
Oct 30 22:21:47.704312 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.704286    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:21:47.704312 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.704298    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:21:47.751074 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.751047    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-69w5k\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.751199 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.751132    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-69w5k\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.751199 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.751185    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpfd6\" (UniqueName: \"kubernetes.io/projected/b5e94810-cde2-458c-934a-be139bafcabe-kube-api-access-qpfd6\") pod \"maas-api-revoke-sub-e2fc9c5b-69w5k\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.751880 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.751817    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-69w5k\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.753496 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.753475    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-69w5k\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.812264 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.812240    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpfd6\" (UniqueName: \"kubernetes.io/projected/b5e94810-cde2-458c-934a-be139bafcabe-kube-api-access-qpfd6\") pod \"maas-api-revoke-sub-e2fc9c5b-69w5k\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:47.912689 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:47.912665    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:48.288906 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:48.288876    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"]
Oct 30 22:21:48.289735 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:21:48.289699    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e94810_cde2_458c_934a_be139bafcabe.slice/crio-4b8357f69fcad2176e52aab607b481f2233639361751e89025d07a48841a9a03 WatchSource:0}: Error finding container 4b8357f69fcad2176e52aab607b481f2233639361751e89025d07a48841a9a03: Status 404 returned error can't find the container with id 4b8357f69fcad2176e52aab607b481f2233639361751e89025d07a48841a9a03
Oct 30 22:21:48.314313 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:48.314288    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k" event={"ID":"b5e94810-cde2-458c-934a-be139bafcabe","Type":"ContainerStarted","Data":"4b8357f69fcad2176e52aab607b481f2233639361751e89025d07a48841a9a03"}
Oct 30 22:21:49.322211 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:49.322170    5575 generic.go:356] "Generic (PLEG): container finished" podID="b5e94810-cde2-458c-934a-be139bafcabe" containerID="65526de25d9f520cf49ceef0ada5c53f10010ba644876e65320cda9ed2decd56" exitCode=0
Oct 30 22:21:49.322621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:49.322253    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k" event={"ID":"b5e94810-cde2-458c-934a-be139bafcabe","Type":"ContainerDied","Data":"65526de25d9f520cf49ceef0ada5c53f10010ba644876e65320cda9ed2decd56"}
Oct 30 22:21:50.473784 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.473760    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:50.576074 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.576049    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-openshift-ca\") pod \"b5e94810-cde2-458c-934a-be139bafcabe\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") "
Oct 30 22:21:50.576222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.576143    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5e94810-cde2-458c-934a-be139bafcabe-kube-api-access-qpfd6\" (UniqueName: \"kubernetes.io/projected/b5e94810-cde2-458c-934a-be139bafcabe-kube-api-access-qpfd6\") pod \"b5e94810-cde2-458c-934a-be139bafcabe\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") "
Oct 30 22:21:50.576222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.576193    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-xks-ca\") pod \"b5e94810-cde2-458c-934a-be139bafcabe\" (UID: \"b5e94810-cde2-458c-934a-be139bafcabe\") "
Oct 30 22:21:50.576396 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.576375    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-openshift-ca" pod "b5e94810-cde2-458c-934a-be139bafcabe" (UID: "b5e94810-cde2-458c-934a-be139bafcabe"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:21:50.578407 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.578348    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-xks-ca" pod "b5e94810-cde2-458c-934a-be139bafcabe" (UID: "b5e94810-cde2-458c-934a-be139bafcabe"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:21:50.578506 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.578411    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e94810-cde2-458c-934a-be139bafcabe-kube-api-access-qpfd6" pod "b5e94810-cde2-458c-934a-be139bafcabe" (UID: "b5e94810-cde2-458c-934a-be139bafcabe"). InnerVolumeSpecName "kube-api-access-qpfd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:50.677013 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.676958    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpfd6\" (UniqueName: \"kubernetes.io/projected/b5e94810-cde2-458c-934a-be139bafcabe-kube-api-access-qpfd6\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:50.677013 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.677014    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:50.677199 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:50.677024    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b5e94810-cde2-458c-934a-be139bafcabe-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:51.335139 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:51.335116    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"
Oct 30 22:21:51.335139 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:51.335133    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k" event={"ID":"b5e94810-cde2-458c-934a-be139bafcabe","Type":"ContainerDied","Data":"4b8357f69fcad2176e52aab607b481f2233639361751e89025d07a48841a9a03"}
Oct 30 22:21:51.335332 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:51.335171    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b8357f69fcad2176e52aab607b481f2233639361751e89025d07a48841a9a03"
Oct 30 22:21:52.539677 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:52.539633    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:53.484473 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:21:53.484434    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:21:53.544208 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:53.544138    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:58.424129 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.424094    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"]
Oct 30 22:21:58.424609 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.424595    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b5e94810-cde2-458c-934a-be139bafcabe" containerName="revoke-keys"
Oct 30 22:21:58.424655 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.424610    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5e94810-cde2-458c-934a-be139bafcabe" containerName="revoke-keys"
Oct 30 22:21:58.424691 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.424681    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5e94810-cde2-458c-934a-be139bafcabe" containerName="revoke-keys"
Oct 30 22:21:58.427871 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.427846    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.534568 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.534530    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:21:58.534747 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.534569    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:21:58.538018 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.537998    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"]
Oct 30 22:21:58.546833 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.546798    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nksc\" (UniqueName: \"kubernetes.io/projected/3eac0740-0191-44da-b9ed-2d33f1dde719-kube-api-access-9nksc\") pod \"maas-api-revoke-sub-5a29efb3-bs4cw\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.547021 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.546883    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a29efb3-bs4cw\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.547021 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.547006    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a29efb3-bs4cw\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.648189 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.648159    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a29efb3-bs4cw\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.648311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.648197    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a29efb3-bs4cw\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.648311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.648276    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nksc\" (UniqueName: \"kubernetes.io/projected/3eac0740-0191-44da-b9ed-2d33f1dde719-kube-api-access-9nksc\") pod \"maas-api-revoke-sub-5a29efb3-bs4cw\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.649001 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.648956    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a29efb3-bs4cw\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.650731 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.650701    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a29efb3-bs4cw\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.709279 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.709223    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nksc\" (UniqueName: \"kubernetes.io/projected/3eac0740-0191-44da-b9ed-2d33f1dde719-kube-api-access-9nksc\") pod \"maas-api-revoke-sub-5a29efb3-bs4cw\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:58.742270 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:58.742246    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:21:59.118176 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:59.118151    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"]
Oct 30 22:21:59.119266 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:21:59.119239    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eac0740_0191_44da_b9ed_2d33f1dde719.slice/crio-554190dc2b31de9824d8877e2b36bbaea7142fd667b1aa1d92ad1e668a0e53ac WatchSource:0}: Error finding container 554190dc2b31de9824d8877e2b36bbaea7142fd667b1aa1d92ad1e668a0e53ac: Status 404 returned error can't find the container with id 554190dc2b31de9824d8877e2b36bbaea7142fd667b1aa1d92ad1e668a0e53ac
Oct 30 22:21:59.385440 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:21:59.385413    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw" event={"ID":"3eac0740-0191-44da-b9ed-2d33f1dde719","Type":"ContainerStarted","Data":"554190dc2b31de9824d8877e2b36bbaea7142fd667b1aa1d92ad1e668a0e53ac"}
Oct 30 22:22:00.393932 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:00.393899    5575 generic.go:356] "Generic (PLEG): container finished" podID="3eac0740-0191-44da-b9ed-2d33f1dde719" containerID="1d85173fd89abd9af044513d740750ee44e835f72d33db30f401fbd42b5f042e" exitCode=0
Oct 30 22:22:00.394341 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:00.393998    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw" event={"ID":"3eac0740-0191-44da-b9ed-2d33f1dde719","Type":"ContainerDied","Data":"1d85173fd89abd9af044513d740750ee44e835f72d33db30f401fbd42b5f042e"}
Oct 30 22:22:01.308765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.308720    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:01.638342 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.638314    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:22:01.680800 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.680756    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-xks-ca\") pod \"3eac0740-0191-44da-b9ed-2d33f1dde719\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") "
Oct 30 22:22:01.680926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.680870    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-openshift-ca\") pod \"3eac0740-0191-44da-b9ed-2d33f1dde719\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") "
Oct 30 22:22:01.680926 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.680912    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3eac0740-0191-44da-b9ed-2d33f1dde719-kube-api-access-9nksc\" (UniqueName: \"kubernetes.io/projected/3eac0740-0191-44da-b9ed-2d33f1dde719-kube-api-access-9nksc\") pod \"3eac0740-0191-44da-b9ed-2d33f1dde719\" (UID: \"3eac0740-0191-44da-b9ed-2d33f1dde719\") "
Oct 30 22:22:01.681531 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.681499    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-openshift-ca" pod "3eac0740-0191-44da-b9ed-2d33f1dde719" (UID: "3eac0740-0191-44da-b9ed-2d33f1dde719"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:22:01.683916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.683888    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eac0740-0191-44da-b9ed-2d33f1dde719-kube-api-access-9nksc" pod "3eac0740-0191-44da-b9ed-2d33f1dde719" (UID: "3eac0740-0191-44da-b9ed-2d33f1dde719"). InnerVolumeSpecName "kube-api-access-9nksc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:01.684087 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.683946    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-xks-ca" pod "3eac0740-0191-44da-b9ed-2d33f1dde719" (UID: "3eac0740-0191-44da-b9ed-2d33f1dde719"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:22:01.782375 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.782262    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:01.782375 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.782318    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nksc\" (UniqueName: \"kubernetes.io/projected/3eac0740-0191-44da-b9ed-2d33f1dde719-kube-api-access-9nksc\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:01.782375 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:01.782335    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3eac0740-0191-44da-b9ed-2d33f1dde719-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:02.456992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:02.456485    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw" event={"ID":"3eac0740-0191-44da-b9ed-2d33f1dde719","Type":"ContainerDied","Data":"554190dc2b31de9824d8877e2b36bbaea7142fd667b1aa1d92ad1e668a0e53ac"}
Oct 30 22:22:02.456992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:02.456576    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="554190dc2b31de9824d8877e2b36bbaea7142fd667b1aa1d92ad1e668a0e53ac"
Oct 30 22:22:02.456992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:02.456653    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"
Oct 30 22:22:15.737827 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.737786    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"]
Oct 30 22:22:15.787657 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.787621    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bv27w"]
Oct 30 22:22:15.861592 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.861469    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"]
Oct 30 22:22:15.861925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.861910    5575 cpu_manager.go:414] "containerMap: removing container" podUID="3eac0740-0191-44da-b9ed-2d33f1dde719" containerName="revoke-keys"
Oct 30 22:22:15.861925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.861924    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3eac0740-0191-44da-b9ed-2d33f1dde719" containerName="revoke-keys"
Oct 30 22:22:15.862129 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.862037    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="3eac0740-0191-44da-b9ed-2d33f1dde719" containerName="revoke-keys"
Oct 30 22:22:15.865295 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.865272    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:15.915107 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.915083    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxzn2\" (UniqueName: \"kubernetes.io/projected/d69055e7-c110-4a80-a02c-d3155f051439-kube-api-access-bxzn2\") pod \"maas-api-revoke-sub-3d4156f1-p2q6d\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:15.915244 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.915125    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-p2q6d\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:15.915330 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.915307    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-p2q6d\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:15.919145 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.919116    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:22:15.919274 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.919255    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:22:15.921711 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:15.921690    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"]
Oct 30 22:22:16.016672 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:16.016572    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-p2q6d\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:16.016672 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:16.016663    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxzn2\" (UniqueName: \"kubernetes.io/projected/d69055e7-c110-4a80-a02c-d3155f051439-kube-api-access-bxzn2\") pod \"maas-api-revoke-sub-3d4156f1-p2q6d\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:16.016897 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:16.016692    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-p2q6d\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:16.017326 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:16.017305    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-p2q6d\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:16.019113 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:16.019091    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-p2q6d\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:16.078174 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:16.078144    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxzn2\" (UniqueName: \"kubernetes.io/projected/d69055e7-c110-4a80-a02c-d3155f051439-kube-api-access-bxzn2\") pod \"maas-api-revoke-sub-3d4156f1-p2q6d\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:16.178368 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:16.178341    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:16.562494 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:16.562468    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"]
Oct 30 22:22:16.564270 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:22:16.564243    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69055e7_c110_4a80_a02c_d3155f051439.slice/crio-ea5330277b238dc45a5a81a8656762f7ddee1709f5bf4d8740c853ef398f2d2a WatchSource:0}: Error finding container ea5330277b238dc45a5a81a8656762f7ddee1709f5bf4d8740c853ef398f2d2a: Status 404 returned error can't find the container with id ea5330277b238dc45a5a81a8656762f7ddee1709f5bf4d8740c853ef398f2d2a
Oct 30 22:22:16.587248 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:16.587223    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d" event={"ID":"d69055e7-c110-4a80-a02c-d3155f051439","Type":"ContainerStarted","Data":"ea5330277b238dc45a5a81a8656762f7ddee1709f5bf4d8740c853ef398f2d2a"}
Oct 30 22:22:17.125807 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:17.125731    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f9e0cad-5c1d-44f1-bcb5-cfb075372524" path="/var/lib/kubelet/pods/7f9e0cad-5c1d-44f1-bcb5-cfb075372524/volumes"
Oct 30 22:22:17.594638 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:17.594608    5575 generic.go:356] "Generic (PLEG): container finished" podID="d69055e7-c110-4a80-a02c-d3155f051439" containerID="86c042dd745229429beb210c6aebbcf2d93881be6f563e514ab41d76ac4aff72" exitCode=0
Oct 30 22:22:17.594777 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:17.594690    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d" event={"ID":"d69055e7-c110-4a80-a02c-d3155f051439","Type":"ContainerDied","Data":"86c042dd745229429beb210c6aebbcf2d93881be6f563e514ab41d76ac4aff72"}
Oct 30 22:22:18.750865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.750839    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:18.843324 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.843288    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-openshift-ca\") pod \"d69055e7-c110-4a80-a02c-d3155f051439\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") "
Oct 30 22:22:18.843462 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.843370    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-xks-ca\") pod \"d69055e7-c110-4a80-a02c-d3155f051439\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") "
Oct 30 22:22:18.843462 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.843446    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d69055e7-c110-4a80-a02c-d3155f051439-kube-api-access-bxzn2\" (UniqueName: \"kubernetes.io/projected/d69055e7-c110-4a80-a02c-d3155f051439-kube-api-access-bxzn2\") pod \"d69055e7-c110-4a80-a02c-d3155f051439\" (UID: \"d69055e7-c110-4a80-a02c-d3155f051439\") "
Oct 30 22:22:18.843665 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.843644    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-openshift-ca" pod "d69055e7-c110-4a80-a02c-d3155f051439" (UID: "d69055e7-c110-4a80-a02c-d3155f051439"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:22:18.843776 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.843759    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:18.845514 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.845481    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-xks-ca" pod "d69055e7-c110-4a80-a02c-d3155f051439" (UID: "d69055e7-c110-4a80-a02c-d3155f051439"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:22:18.845732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.845714    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d69055e7-c110-4a80-a02c-d3155f051439-kube-api-access-bxzn2" pod "d69055e7-c110-4a80-a02c-d3155f051439" (UID: "d69055e7-c110-4a80-a02c-d3155f051439"). InnerVolumeSpecName "kube-api-access-bxzn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:18.944752 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.944705    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxzn2\" (UniqueName: \"kubernetes.io/projected/d69055e7-c110-4a80-a02c-d3155f051439-kube-api-access-bxzn2\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:18.944752 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:18.944747    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d69055e7-c110-4a80-a02c-d3155f051439-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:19.617313 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:19.617241    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"
Oct 30 22:22:19.617586 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:19.617265    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d" event={"ID":"d69055e7-c110-4a80-a02c-d3155f051439","Type":"ContainerDied","Data":"ea5330277b238dc45a5a81a8656762f7ddee1709f5bf4d8740c853ef398f2d2a"}
Oct 30 22:22:19.617704 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:19.617646    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea5330277b238dc45a5a81a8656762f7ddee1709f5bf4d8740c853ef398f2d2a"
Oct 30 22:22:20.809061 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:20.809034    5575 scope.go:122] "RemoveContainer" containerID="8a9142540d13f5d2bec0940ff8b145b1a2b358fb7d45ca7aadcfef8092520983"
Oct 30 22:22:20.818919 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:20.818895    5575 scope.go:122] "RemoveContainer" containerID="da0bb0a2e7e7641f09fd670acbc1a51933dfd8a730ab67ea540b0c28aedef147"
Oct 30 22:22:22.048221 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:22.048184    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"]
Oct 30 22:22:22.098656 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:22.098628    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-wjvrj"]
Oct 30 22:22:23.125669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:23.125641    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e5dc00e-4413-4c61-8133-e367890c2b53" path="/var/lib/kubelet/pods/6e5dc00e-4413-4c61-8133-e367890c2b53/volumes"
Oct 30 22:22:23.486369 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:22:23.486335    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:22:43.047347 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:43.047314    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"]
Oct 30 22:22:43.096464 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:43.096432    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-vg2nx"]
Oct 30 22:22:43.125433 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:43.125396    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16b60c3f-f905-4e66-a401-dfa2554f803f" path="/var/lib/kubelet/pods/16b60c3f-f905-4e66-a401-dfa2554f803f/volumes"
Oct 30 22:22:48.316790 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.316755    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:48.836719 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.836683    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"]
Oct 30 22:22:48.837194 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.837176    5575 cpu_manager.go:414] "containerMap: removing container" podUID="d69055e7-c110-4a80-a02c-d3155f051439" containerName="revoke-keys"
Oct 30 22:22:48.837194 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.837194    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d69055e7-c110-4a80-a02c-d3155f051439" containerName="revoke-keys"
Oct 30 22:22:48.837326 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.837294    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="d69055e7-c110-4a80-a02c-d3155f051439" containerName="revoke-keys"
Oct 30 22:22:48.841802 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.841783    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.892868    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-certs\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.892930    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc79b11-ae90-4fba-860b-296f996e2d7a-istiod-ca-cert\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.892993    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-credential-socket\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.893057    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-data\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.893100    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-podinfo\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.893132    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-kube-api-access-4pdgl\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.893177    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-envoy\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.893228    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-socket\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.893293    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-token\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.899993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.894926    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-1e5514-openshift-default-dockercfg-t5g7n\""
Oct 30 22:22:48.951443 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.951414    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"]
Oct 30 22:22:48.964791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.964742    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:48.995292 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.995253    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-socket\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.995508 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.995342    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-token\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.995508 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.995397    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-certs\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.995508 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.995430    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc79b11-ae90-4fba-860b-296f996e2d7a-istiod-ca-cert\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.995508 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.995454    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-credential-socket\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.995755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.995517    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-data\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.995755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.995589    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-podinfo\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.995755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.995623    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-kube-api-access-4pdgl\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.995755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.995699    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-envoy\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.997388 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.997363    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc79b11-ae90-4fba-860b-296f996e2d7a-istiod-ca-cert\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.997796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.997768    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-socket\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.998158 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.998133    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-data\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.998381 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.998359    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-certs\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.998499 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.998381    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-credential-socket\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:48.999256 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:48.999228    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-envoy\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:49.001501 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.001478    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-podinfo\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:49.059160 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.059129    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-token\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:49.059271 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.059166    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-kube-api-access-4pdgl\") pod \"e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") " pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:49.154487 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.154461    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:49.263668 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.263635    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:49.592579 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.592554    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"]
Oct 30 22:22:49.594126 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:22:49.594095    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc79b11_ae90_4fba_860b_296f996e2d7a.slice/crio-f3a19796518e4b3f10b8779b37da507aa206edab7004867cee5b53eef2f1a4fa WatchSource:0}: Error finding container f3a19796518e4b3f10b8779b37da507aa206edab7004867cee5b53eef2f1a4fa: Status 404 returned error can't find the container with id f3a19796518e4b3f10b8779b37da507aa206edab7004867cee5b53eef2f1a4fa
Oct 30 22:22:49.596376 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.596343    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:22:49.596489 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.596420    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:22:49.596489 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.596467    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:22:49.842575 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.842482    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" event={"ID":"0cc79b11-ae90-4fba-860b-296f996e2d7a","Type":"ContainerStarted","Data":"d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185"}
Oct 30 22:22:49.842743 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.842577    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" event={"ID":"0cc79b11-ae90-4fba-860b-296f996e2d7a","Type":"ContainerStarted","Data":"f3a19796518e4b3f10b8779b37da507aa206edab7004867cee5b53eef2f1a4fa"}
Oct 30 22:22:49.977348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:49.977300    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" podStartSLOduration=1.977285502 podStartE2EDuration="1.977285502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:22:49.973981767 +0000 UTC m=+3571.005830296" watchObservedRunningTime="2026-10-30 22:22:49.977285502 +0000 UTC m=+3571.009134037"
Oct 30 22:22:50.154757 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:50.154728    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:50.159709 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:50.159686    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:50.848484 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:50.848445    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:50.849447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:50.849427    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:22:53.089487 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:53.089452    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:53.436200 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:53.436165    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:53.485114 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:22:53.485076    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:22:53.622194 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:53.622154    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:56.365533 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:56.365494    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:56.537272 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:56.537215    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:59.459960 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:59.459927    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:59.624419 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:59.624383    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:59.784429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:22:59.784350    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:01.649637 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:01.649595    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:04.450902 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:04.450868    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:09.471150 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:09.471109    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:14.407504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:14.407468    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:17.024852 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:17.024826    5575 generic.go:356] "Generic (PLEG): container finished" podID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerID="d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185" exitCode=0
Oct 30 22:23:17.025268 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:17.024903    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" event={"ID":"0cc79b11-ae90-4fba-860b-296f996e2d7a","Type":"ContainerDied","Data":"d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185"}
Oct 30 22:23:17.025326 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:17.025312    5575 scope.go:122] "RemoveContainer" containerID="d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185"
Oct 30 22:23:17.026610 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:17.026582    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:23:17.026677 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:17.026653    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:23:17.026714 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:17.026686    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:23:17.875705 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:17.875671    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:18.037659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:18.037621    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" event={"ID":"0cc79b11-ae90-4fba-860b-296f996e2d7a","Type":"ContainerStarted","Data":"c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f"}
Oct 30 22:23:18.050527 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:18.050501    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"]
Oct 30 22:23:18.100566 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:18.100532    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kcsnd"]
Oct 30 22:23:18.155110 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:18.155075    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:23:18.156299 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:18.156277    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 22:23:18.156360 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:18.156328    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 22:23:18.505660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:18.505579    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:18.678782 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:18.678752    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:18.840783 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:18.840689    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:19.139345 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:19.139302    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fcca32ea-f6b9-4430-b025-d00fe53b93ac" path="/var/lib/kubelet/pods/fcca32ea-f6b9-4430-b025-d00fe53b93ac/volumes"
Oct 30 22:23:19.154893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:19.154860    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 22:23:19.155034 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:19.154902    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 22:23:19.574284 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:19.574201    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:19.852342 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:19.852262    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:23:19.867256 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:19.867229    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:23:19.869330 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:19.869309    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:23:19.885003 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:19.884982    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:23:20.155505 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:20.155470    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 22:23:20.156018 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:20.155536    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 22:23:20.847079 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:20.847045    5575 scope.go:122] "RemoveContainer" containerID="61b7f913576a534527547688503bd3ad604c6be9e398b94de95470cf17e1cfde"
Oct 30 22:23:20.849381 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:20.849360    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:23:20.859765 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:20.859745    5575 scope.go:122] "RemoveContainer" containerID="8b964982fbbc574333466c67368fa90c3951a87eeb57b75734b5893b37dc8168"
Oct 30 22:23:21.155394 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:21.155365    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 22:23:21.155608 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:21.155412    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 22:23:22.155060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:22.155019    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 22:23:22.155241 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:22.155088    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 22:23:22.831551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:22.831509    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:23.158831 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:23.158803    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:23:23.159763 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:23.159743    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:23:23.493828 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:23:23.493743    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:23:24.416172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:24.416139    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:29.395124 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:29.395041    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:34.278532 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:34.278499    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:39.173900 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:39.173865    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:43.989226 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:43.989190    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:46.049478 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:46.049446    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"]
Oct 30 22:23:46.098691 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:46.098661    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nvhdj"]
Oct 30 22:23:47.126180 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:47.126137    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9bf1662d-6afa-4ad5-b688-4c20fac85d55" path="/var/lib/kubelet/pods/9bf1662d-6afa-4ad5-b688-4c20fac85d55/volumes"
Oct 30 22:23:48.968469 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:48.968338    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:53.485478 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:23:53.485442    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:23:53.855820 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:53.855738    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:58.962341 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:23:58.962304    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:02.020514 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:02.020464    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:03.883244 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:03.883206    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:08.796890 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:08.796862    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:13.676161 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:13.676130    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:18.576889 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.576832    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:18.689340 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.689309    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"]
Oct 30 22:24:18.693100 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.693083    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:18.752006 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.751978    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"]
Oct 30 22:24:18.798031 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.798002    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:24:18.798154 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.798041    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:24:18.827748 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.827690    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqlj7\" (UniqueName: \"kubernetes.io/projected/16b568a9-918d-4694-8c56-3a2a3c4209c8-kube-api-access-qqlj7\") pod \"maas-api-revoke-sub-d47848f6-5lqvn\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:18.827748 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.827736    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d47848f6-5lqvn\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:18.827884 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.827811    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d47848f6-5lqvn\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:18.929266 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.929235    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d47848f6-5lqvn\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:18.929382 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.929361    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlj7\" (UniqueName: \"kubernetes.io/projected/16b568a9-918d-4694-8c56-3a2a3c4209c8-kube-api-access-qqlj7\") pod \"maas-api-revoke-sub-d47848f6-5lqvn\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:18.929425 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.929415    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d47848f6-5lqvn\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:18.930091 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.930072    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d47848f6-5lqvn\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:18.931954 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.931934    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d47848f6-5lqvn\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:18.990916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:18.990890    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqlj7\" (UniqueName: \"kubernetes.io/projected/16b568a9-918d-4694-8c56-3a2a3c4209c8-kube-api-access-qqlj7\") pod \"maas-api-revoke-sub-d47848f6-5lqvn\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:19.005563 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:19.005541    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:19.384285 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:19.384262    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"]
Oct 30 22:24:19.386083 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:24:19.386058    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b568a9_918d_4694_8c56_3a2a3c4209c8.slice/crio-a47c2f4538be5ac28a9c14b25360fa2484c8343ee48bfa87eaf7d14f651917ee WatchSource:0}: Error finding container a47c2f4538be5ac28a9c14b25360fa2484c8343ee48bfa87eaf7d14f651917ee: Status 404 returned error can't find the container with id a47c2f4538be5ac28a9c14b25360fa2484c8343ee48bfa87eaf7d14f651917ee
Oct 30 22:24:19.430896 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:19.430873    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn" event={"ID":"16b568a9-918d-4694-8c56-3a2a3c4209c8","Type":"ContainerStarted","Data":"a47c2f4538be5ac28a9c14b25360fa2484c8343ee48bfa87eaf7d14f651917ee"}
Oct 30 22:24:20.439204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:20.439129    5575 generic.go:356] "Generic (PLEG): container finished" podID="16b568a9-918d-4694-8c56-3a2a3c4209c8" containerID="f91fb1dc21a0ecff82fb3b1db5e5a5c0f281a470be3a9f47e0c64153e3bfedce" exitCode=0
Oct 30 22:24:20.439204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:20.439166    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn" event={"ID":"16b568a9-918d-4694-8c56-3a2a3c4209c8","Type":"ContainerDied","Data":"f91fb1dc21a0ecff82fb3b1db5e5a5c0f281a470be3a9f47e0c64153e3bfedce"}
Oct 30 22:24:20.889327 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:20.889302    5575 scope.go:122] "RemoveContainer" containerID="46b4d3c8739f9eec38bd7f0eaba0b15a02c9a2709cbd24ccdeeb0c7ce4567a38"
Oct 30 22:24:20.898992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:20.898951    5575 scope.go:122] "RemoveContainer" containerID="ba6012923b767d3243f3c6503b766e4b4fa9e1037ebf0a4a223ab36a3d9b55fb"
Oct 30 22:24:21.593485 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.593460    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:21.657507 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.657483    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-xks-ca\") pod \"16b568a9-918d-4694-8c56-3a2a3c4209c8\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") "
Oct 30 22:24:21.657633 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.657604    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16b568a9-918d-4694-8c56-3a2a3c4209c8-kube-api-access-qqlj7\" (UniqueName: \"kubernetes.io/projected/16b568a9-918d-4694-8c56-3a2a3c4209c8-kube-api-access-qqlj7\") pod \"16b568a9-918d-4694-8c56-3a2a3c4209c8\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") "
Oct 30 22:24:21.657714 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.657697    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-openshift-ca\") pod \"16b568a9-918d-4694-8c56-3a2a3c4209c8\" (UID: \"16b568a9-918d-4694-8c56-3a2a3c4209c8\") "
Oct 30 22:24:21.658109 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.658083    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-openshift-ca" pod "16b568a9-918d-4694-8c56-3a2a3c4209c8" (UID: "16b568a9-918d-4694-8c56-3a2a3c4209c8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:21.659612 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.659592    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-xks-ca" pod "16b568a9-918d-4694-8c56-3a2a3c4209c8" (UID: "16b568a9-918d-4694-8c56-3a2a3c4209c8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:21.659759 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.659743    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b568a9-918d-4694-8c56-3a2a3c4209c8-kube-api-access-qqlj7" pod "16b568a9-918d-4694-8c56-3a2a3c4209c8" (UID: "16b568a9-918d-4694-8c56-3a2a3c4209c8"). InnerVolumeSpecName "kube-api-access-qqlj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:21.759408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.759339    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqlj7\" (UniqueName: \"kubernetes.io/projected/16b568a9-918d-4694-8c56-3a2a3c4209c8-kube-api-access-qqlj7\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:21.759408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.759368    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:21.759408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:21.759382    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b568a9-918d-4694-8c56-3a2a3c4209c8-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:22.453223 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:22.453175    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"
Oct 30 22:24:22.453397 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:22.453169    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn" event={"ID":"16b568a9-918d-4694-8c56-3a2a3c4209c8","Type":"ContainerDied","Data":"a47c2f4538be5ac28a9c14b25360fa2484c8343ee48bfa87eaf7d14f651917ee"}
Oct 30 22:24:22.453397 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:22.453307    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a47c2f4538be5ac28a9c14b25360fa2484c8343ee48bfa87eaf7d14f651917ee"
Oct 30 22:24:23.474520 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:23.474484    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:23.485928 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:24:23.485898    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:24:27.049377 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:27.049345    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"]
Oct 30 22:24:27.099182 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:27.099152    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-hgr4t"]
Oct 30 22:24:27.126406 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:27.126376    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="636e24e6-d524-4940-bb5a-a98892da998e" path="/var/lib/kubelet/pods/636e24e6-d524-4940-bb5a-a98892da998e/volumes"
Oct 30 22:24:28.363162 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:28.363130    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:33.275372 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:33.275330    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:38.274092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:38.274058    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:40.608635 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:40.608590    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:41.100933 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.100898    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"]
Oct 30 22:24:41.101422 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.101407    5575 cpu_manager.go:414] "containerMap: removing container" podUID="16b568a9-918d-4694-8c56-3a2a3c4209c8" containerName="revoke-keys"
Oct 30 22:24:41.101470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.101425    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16b568a9-918d-4694-8c56-3a2a3c4209c8" containerName="revoke-keys"
Oct 30 22:24:41.101521 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.101511    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="16b568a9-918d-4694-8c56-3a2a3c4209c8" containerName="revoke-keys"
Oct 30 22:24:41.104954 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.104937    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.148740 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.148711    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vqf9\" (UniqueName: \"kubernetes.io/projected/266d9862-67a1-4d73-a24f-5ceb48fcf0af-kube-api-access-5vqf9\") pod \"maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.148880 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.148831    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.148927 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.148906    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.159105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.159083    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:24:41.208925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.208896    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:24:41.211797 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.211777    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"]
Oct 30 22:24:41.249621 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.249585    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.249722 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.249637    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vqf9\" (UniqueName: \"kubernetes.io/projected/266d9862-67a1-4d73-a24f-5ceb48fcf0af-kube-api-access-5vqf9\") pod \"maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.249722 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.249703    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.250206 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.250188    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.252136 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.252115    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.310600 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.310571    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vqf9\" (UniqueName: \"kubernetes.io/projected/266d9862-67a1-4d73-a24f-5ceb48fcf0af-kube-api-access-5vqf9\") pod \"maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.417896 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.417873    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:41.793335 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:41.793308    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"]
Oct 30 22:24:41.794797 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:24:41.794775    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266d9862_67a1_4d73_a24f_5ceb48fcf0af.slice/crio-3966a83d289d901d20f8fe120ed99dd0b905eb40f649b0002539ff206b875888 WatchSource:0}: Error finding container 3966a83d289d901d20f8fe120ed99dd0b905eb40f649b0002539ff206b875888: Status 404 returned error can't find the container with id 3966a83d289d901d20f8fe120ed99dd0b905eb40f649b0002539ff206b875888
Oct 30 22:24:42.593974 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:42.593931    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb" event={"ID":"266d9862-67a1-4d73-a24f-5ceb48fcf0af","Type":"ContainerStarted","Data":"eff62c6243ee7d840027fe26a3f97869488634a3adeea5f1cc8dceeb5817b882"}
Oct 30 22:24:42.594150 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:42.594003    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb" event={"ID":"266d9862-67a1-4d73-a24f-5ceb48fcf0af","Type":"ContainerStarted","Data":"3966a83d289d901d20f8fe120ed99dd0b905eb40f649b0002539ff206b875888"}
Oct 30 22:24:42.710298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:42.710249    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb" podStartSLOduration=1.710235987 podStartE2EDuration="1.710235987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:42.709378367 +0000 UTC m=+3683.741226901" watchObservedRunningTime="2026-10-30 22:24:42.710235987 +0000 UTC m=+3683.742084565"
Oct 30 22:24:43.213329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:43.213296    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:43.601432 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:43.601345    5575 generic.go:356] "Generic (PLEG): container finished" podID="266d9862-67a1-4d73-a24f-5ceb48fcf0af" containerID="eff62c6243ee7d840027fe26a3f97869488634a3adeea5f1cc8dceeb5817b882" exitCode=0
Oct 30 22:24:43.601432 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:43.601391    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb" event={"ID":"266d9862-67a1-4d73-a24f-5ceb48fcf0af","Type":"ContainerDied","Data":"eff62c6243ee7d840027fe26a3f97869488634a3adeea5f1cc8dceeb5817b882"}
Oct 30 22:24:44.757413 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.757387    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:44.781632 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.781607    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-openshift-ca\") pod \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") "
Oct 30 22:24:44.781740 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.781654    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/266d9862-67a1-4d73-a24f-5ceb48fcf0af-kube-api-access-5vqf9\" (UniqueName: \"kubernetes.io/projected/266d9862-67a1-4d73-a24f-5ceb48fcf0af-kube-api-access-5vqf9\") pod \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") "
Oct 30 22:24:44.781740 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.781714    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-xks-ca\") pod \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\" (UID: \"266d9862-67a1-4d73-a24f-5ceb48fcf0af\") "
Oct 30 22:24:44.782021 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.782001    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-openshift-ca" pod "266d9862-67a1-4d73-a24f-5ceb48fcf0af" (UID: "266d9862-67a1-4d73-a24f-5ceb48fcf0af"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:44.782144 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.782122    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:44.783881 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.783849    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-xks-ca" pod "266d9862-67a1-4d73-a24f-5ceb48fcf0af" (UID: "266d9862-67a1-4d73-a24f-5ceb48fcf0af"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:44.784027 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.784003    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/266d9862-67a1-4d73-a24f-5ceb48fcf0af-kube-api-access-5vqf9" pod "266d9862-67a1-4d73-a24f-5ceb48fcf0af" (UID: "266d9862-67a1-4d73-a24f-5ceb48fcf0af"). InnerVolumeSpecName "kube-api-access-5vqf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:44.885727 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.885696    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vqf9\" (UniqueName: \"kubernetes.io/projected/266d9862-67a1-4d73-a24f-5ceb48fcf0af-kube-api-access-5vqf9\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:44.885896 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:44.885729    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/266d9862-67a1-4d73-a24f-5ceb48fcf0af-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:45.616009 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:45.615957    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"
Oct 30 22:24:45.616183 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:45.615958    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb" event={"ID":"266d9862-67a1-4d73-a24f-5ceb48fcf0af","Type":"ContainerDied","Data":"3966a83d289d901d20f8fe120ed99dd0b905eb40f649b0002539ff206b875888"}
Oct 30 22:24:45.616183 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:45.616098    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3966a83d289d901d20f8fe120ed99dd0b905eb40f649b0002539ff206b875888"
Oct 30 22:24:45.646017 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:45.645961    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:48.519712 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:48.519679    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:51.050432 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:51.050400    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"]
Oct 30 22:24:51.100177 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:51.100151    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-rzttj"]
Oct 30 22:24:51.126045 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:51.126017    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d" path="/var/lib/kubelet/pods/1ec8bfb3-7ce0-45c0-a48b-d8c09d66859d/volumes"
Oct 30 22:24:53.029103 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:53.029074    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:53.185138 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:53.185089    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:53.382599 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:53.382568    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:53.485656 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:24:53.485618    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:24:57.654010 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:57.653977    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:59.235593 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:59.235519    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:59.515121 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:59.515015    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:59.849924 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:59.849842    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"]
Oct 30 22:24:59.899251 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:24:59.899224    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-1e5514-dknlb"]
Oct 30 22:25:00.334496 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:00.334465    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:01.126026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:01.125961    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="266d9862-67a1-4d73-a24f-5ceb48fcf0af" path="/var/lib/kubelet/pods/266d9862-67a1-4d73-a24f-5ceb48fcf0af/volumes"
Oct 30 22:25:02.359663 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:02.359629    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:06.596593 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:06.596553    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:06.755503 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:06.755469    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:06.950708 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:06.950676    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"]
Oct 30 22:25:06.950907 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:06.950882    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy" containerID="cri-o://c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f" gracePeriod=30
Oct 30 22:25:06.966672 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:06.966643    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:08.161279 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.161243    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:25:08.161664 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.161301    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:25:08.615955 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.615869    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"]
Oct 30 22:25:08.665071 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.665041    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2q6d"]
Oct 30 22:25:08.743702 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.743674    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"]
Oct 30 22:25:08.744210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.744194    5575 cpu_manager.go:414] "containerMap: removing container" podUID="266d9862-67a1-4d73-a24f-5ceb48fcf0af" containerName="revoke-keys"
Oct 30 22:25:08.744268 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.744212    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="266d9862-67a1-4d73-a24f-5ceb48fcf0af" containerName="revoke-keys"
Oct 30 22:25:08.744332 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.744320    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="266d9862-67a1-4d73-a24f-5ceb48fcf0af" containerName="revoke-keys"
Oct 30 22:25:08.747680 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.747663    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:08.802348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.802266    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:25:08.802923 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.802899    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:25:08.805625 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.805602    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"]
Oct 30 22:25:08.817287 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.817265    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-lt8x9\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:08.817380 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.817313    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckpx\" (UniqueName: \"kubernetes.io/projected/8f2acac1-4ee7-473b-aa48-f4c633359b35-kube-api-access-9ckpx\") pod \"maas-api-revoke-sub-3d4156f1-lt8x9\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:08.817457 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.817444    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-lt8x9\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:08.918209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.918180    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-lt8x9\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:08.918345 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.918230    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckpx\" (UniqueName: \"kubernetes.io/projected/8f2acac1-4ee7-473b-aa48-f4c633359b35-kube-api-access-9ckpx\") pod \"maas-api-revoke-sub-3d4156f1-lt8x9\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:08.918345 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.918313    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-lt8x9\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:08.918806 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.918768    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-lt8x9\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:08.920759 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.920735    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-lt8x9\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:08.979710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:08.979686    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckpx\" (UniqueName: \"kubernetes.io/projected/8f2acac1-4ee7-473b-aa48-f4c633359b35-kube-api-access-9ckpx\") pod \"maas-api-revoke-sub-3d4156f1-lt8x9\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:09.065022 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:09.064989    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:09.138853 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:09.133776    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d69055e7-c110-4a80-a02c-d3155f051439" path="/var/lib/kubelet/pods/d69055e7-c110-4a80-a02c-d3155f051439/volumes"
Oct 30 22:25:09.466489 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:09.466460    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"]
Oct 30 22:25:09.467768 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:25:09.467742    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2acac1_4ee7_473b_aa48_f4c633359b35.slice/crio-45e82abbf976a5b0274bb895630ef531228ebe63cc060906130555772fdeb6fa WatchSource:0}: Error finding container 45e82abbf976a5b0274bb895630ef531228ebe63cc060906130555772fdeb6fa: Status 404 returned error can't find the container with id 45e82abbf976a5b0274bb895630ef531228ebe63cc060906130555772fdeb6fa
Oct 30 22:25:09.774282 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:09.774242    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9" event={"ID":"8f2acac1-4ee7-473b-aa48-f4c633359b35","Type":"ContainerStarted","Data":"81dd3c3c70f64d1777ada74f879f0bb3b2f66e840d4b3e5fbf3714c24387cd29"}
Oct 30 22:25:09.774408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:09.774332    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9" event={"ID":"8f2acac1-4ee7-473b-aa48-f4c633359b35","Type":"ContainerStarted","Data":"45e82abbf976a5b0274bb895630ef531228ebe63cc060906130555772fdeb6fa"}
Oct 30 22:25:09.894788 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:09.894734    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9" podStartSLOduration=1.8947203400000001 podStartE2EDuration="1.89472034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:09.893014526 +0000 UTC m=+3710.924863062" watchObservedRunningTime="2026-10-30 22:25:09.89472034 +0000 UTC m=+3710.926568875"
Oct 30 22:25:10.781661 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:10.781628    5575 generic.go:356] "Generic (PLEG): container finished" podID="8f2acac1-4ee7-473b-aa48-f4c633359b35" containerID="81dd3c3c70f64d1777ada74f879f0bb3b2f66e840d4b3e5fbf3714c24387cd29" exitCode=0
Oct 30 22:25:10.782063 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:10.781713    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9" event={"ID":"8f2acac1-4ee7-473b-aa48-f4c633359b35","Type":"ContainerDied","Data":"81dd3c3c70f64d1777ada74f879f0bb3b2f66e840d4b3e5fbf3714c24387cd29"}
Oct 30 22:25:11.937070 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:11.937049    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:12.050796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.050735    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-openshift-ca\") pod \"8f2acac1-4ee7-473b-aa48-f4c633359b35\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") "
Oct 30 22:25:12.050923 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.050822    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f2acac1-4ee7-473b-aa48-f4c633359b35-kube-api-access-9ckpx\" (UniqueName: \"kubernetes.io/projected/8f2acac1-4ee7-473b-aa48-f4c633359b35-kube-api-access-9ckpx\") pod \"8f2acac1-4ee7-473b-aa48-f4c633359b35\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") "
Oct 30 22:25:12.051012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.050927    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-xks-ca\") pod \"8f2acac1-4ee7-473b-aa48-f4c633359b35\" (UID: \"8f2acac1-4ee7-473b-aa48-f4c633359b35\") "
Oct 30 22:25:12.051087 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.051049    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-openshift-ca" pod "8f2acac1-4ee7-473b-aa48-f4c633359b35" (UID: "8f2acac1-4ee7-473b-aa48-f4c633359b35"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:12.051238 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.051219    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.052894 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.052871    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f2acac1-4ee7-473b-aa48-f4c633359b35-kube-api-access-9ckpx" pod "8f2acac1-4ee7-473b-aa48-f4c633359b35" (UID: "8f2acac1-4ee7-473b-aa48-f4c633359b35"). InnerVolumeSpecName "kube-api-access-9ckpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:12.053044 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.053026    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-xks-ca" pod "8f2acac1-4ee7-473b-aa48-f4c633359b35" (UID: "8f2acac1-4ee7-473b-aa48-f4c633359b35"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:12.153263 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.153224    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f2acac1-4ee7-473b-aa48-f4c633359b35-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.153429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.153266    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ckpx\" (UniqueName: \"kubernetes.io/projected/8f2acac1-4ee7-473b-aa48-f4c633359b35-kube-api-access-9ckpx\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.200372 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.200345    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:25:12.355051 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.354948    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-socket\") pod \"0cc79b11-ae90-4fba-860b-296f996e2d7a\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") "
Oct 30 22:25:12.355209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355052    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-token\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-token\") pod \"0cc79b11-ae90-4fba-860b-296f996e2d7a\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") "
Oct 30 22:25:12.355209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355084    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-credential-socket\") pod \"0cc79b11-ae90-4fba-860b-296f996e2d7a\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") "
Oct 30 22:25:12.355209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355129    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-podinfo\") pod \"0cc79b11-ae90-4fba-860b-296f996e2d7a\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") "
Oct 30 22:25:12.355209 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355169    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0cc79b11-ae90-4fba-860b-296f996e2d7a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc79b11-ae90-4fba-860b-296f996e2d7a-istiod-ca-cert\") pod \"0cc79b11-ae90-4fba-860b-296f996e2d7a\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") "
Oct 30 22:25:12.355458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355217    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-certs\") pod \"0cc79b11-ae90-4fba-860b-296f996e2d7a\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") "
Oct 30 22:25:12.355458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355260    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-socket" pod "0cc79b11-ae90-4fba-860b-296f996e2d7a" (UID: "0cc79b11-ae90-4fba-860b-296f996e2d7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:12.355458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355270    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-kube-api-access-4pdgl\") pod \"0cc79b11-ae90-4fba-860b-296f996e2d7a\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") "
Oct 30 22:25:12.355458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355393    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-data\") pod \"0cc79b11-ae90-4fba-860b-296f996e2d7a\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") "
Oct 30 22:25:12.355458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355398    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-credential-socket" pod "0cc79b11-ae90-4fba-860b-296f996e2d7a" (UID: "0cc79b11-ae90-4fba-860b-296f996e2d7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:12.355458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355428    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-envoy\") pod \"0cc79b11-ae90-4fba-860b-296f996e2d7a\" (UID: \"0cc79b11-ae90-4fba-860b-296f996e2d7a\") "
Oct 30 22:25:12.355796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355608    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-data" pod "0cc79b11-ae90-4fba-860b-296f996e2d7a" (UID: "0cc79b11-ae90-4fba-860b-296f996e2d7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:12.355860 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355826    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cc79b11-ae90-4fba-860b-296f996e2d7a-istiod-ca-cert" pod "0cc79b11-ae90-4fba-860b-296f996e2d7a" (UID: "0cc79b11-ae90-4fba-860b-296f996e2d7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:12.355923 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355896    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.356029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355919    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.356029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.355936    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.356203 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.356137    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-certs" pod "0cc79b11-ae90-4fba-860b-296f996e2d7a" (UID: "0cc79b11-ae90-4fba-860b-296f996e2d7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:12.358050 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.358022    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-kube-api-access-4pdgl" pod "0cc79b11-ae90-4fba-860b-296f996e2d7a" (UID: "0cc79b11-ae90-4fba-860b-296f996e2d7a"). InnerVolumeSpecName "kube-api-access-4pdgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:12.358050 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.358020    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-token" pod "0cc79b11-ae90-4fba-860b-296f996e2d7a" (UID: "0cc79b11-ae90-4fba-860b-296f996e2d7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:12.358259 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.358193    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-envoy" pod "0cc79b11-ae90-4fba-860b-296f996e2d7a" (UID: "0cc79b11-ae90-4fba-860b-296f996e2d7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:12.358453 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.358438    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-podinfo" pod "0cc79b11-ae90-4fba-860b-296f996e2d7a" (UID: "0cc79b11-ae90-4fba-860b-296f996e2d7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:25:12.457199 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.457168    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-kube-api-access-4pdgl\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.457199 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.457193    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.457199 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.457204    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.457421 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.457212    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc79b11-ae90-4fba-860b-296f996e2d7a-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.457421 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.457221    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc79b11-ae90-4fba-860b-296f996e2d7a-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.457421 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.457229    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc79b11-ae90-4fba-860b-296f996e2d7a-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.794618 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.794586    5575 generic.go:356] "Generic (PLEG): container finished" podID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerID="c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f" exitCode=0
Oct 30 22:25:12.794819 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.794637    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"
Oct 30 22:25:12.794819 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.794672    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" event={"ID":"0cc79b11-ae90-4fba-860b-296f996e2d7a","Type":"ContainerDied","Data":"c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f"}
Oct 30 22:25:12.794819 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.794733    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm" event={"ID":"0cc79b11-ae90-4fba-860b-296f996e2d7a","Type":"ContainerDied","Data":"f3a19796518e4b3f10b8779b37da507aa206edab7004867cee5b53eef2f1a4fa"}
Oct 30 22:25:12.794819 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.794759    5575 scope.go:122] "RemoveContainer" containerID="c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f"
Oct 30 22:25:12.796471 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.796171    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"
Oct 30 22:25:12.796471 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.796225    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9" event={"ID":"8f2acac1-4ee7-473b-aa48-f4c633359b35","Type":"ContainerDied","Data":"45e82abbf976a5b0274bb895630ef531228ebe63cc060906130555772fdeb6fa"}
Oct 30 22:25:12.796471 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.796266    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45e82abbf976a5b0274bb895630ef531228ebe63cc060906130555772fdeb6fa"
Oct 30 22:25:12.805848 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.805830    5575 scope.go:122] "RemoveContainer" containerID="d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185"
Oct 30 22:25:12.819465 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.819440    5575 scope.go:122] "RemoveContainer" containerID="c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f"
Oct 30 22:25:12.819749 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:25:12.819730    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f\": container with ID starting with c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f not found: ID does not exist" containerID="c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f"
Oct 30 22:25:12.819805 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.819758    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f"} err="failed to get container status \"c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f\": rpc error: code = NotFound desc = could not find container \"c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f\": container with ID starting with c16790c10620a1c41fcf6708fcf3635e05bf54b17990f145e217c747e096060f not found: ID does not exist"
Oct 30 22:25:12.819805 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.819776    5575 scope.go:122] "RemoveContainer" containerID="d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185"
Oct 30 22:25:12.820038 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:25:12.820017    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185\": container with ID starting with d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185 not found: ID does not exist" containerID="d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185"
Oct 30 22:25:12.820113 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:12.820052    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185"} err="failed to get container status \"d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185\": rpc error: code = NotFound desc = could not find container \"d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185\": container with ID starting with d3a21ec8765aa93904895afb9a30d8d8be150ffae1c5a2367c7440d97ed02185 not found: ID does not exist"
Oct 30 22:25:13.014319 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:13.014288    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"]
Oct 30 22:25:13.019219 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:13.019194    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-1e5514-openshift-default-597689c77cwfsrm"]
Oct 30 22:25:13.126411 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:13.126337    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" path="/var/lib/kubelet/pods/0cc79b11-ae90-4fba-860b-296f996e2d7a/volumes"
Oct 30 22:25:20.926176 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:20.926140    5575 scope.go:122] "RemoveContainer" containerID="72af265aa65d1c969632c0f856ad1a738cbc899dcf01d3bfaffc3e15f624572c"
Oct 30 22:25:21.795161 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:21.795113    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:23.147211 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:23.147183    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:23.486625 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:25:23.486532    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:25:29.381980 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:29.381924    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:35.531727 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:35.531681    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:35.686266 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:35.686233    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:36.045311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:36.045279    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:36.215925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:36.215896    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:44.013304 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:44.013264    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"]
Oct 30 22:25:44.013720 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:44.013475    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd" podUID="b408058e-f89c-4b4a-a3b5-bd06a840daac" containerName="manager" containerID="cri-o://7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477" gracePeriod=10
Oct 30 22:25:44.277583 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:44.277514    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 22:25:44.387833 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:44.387805    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b408058e-f89c-4b4a-a3b5-bd06a840daac-kube-api-access-fvtv8\" (UniqueName: \"kubernetes.io/projected/b408058e-f89c-4b4a-a3b5-bd06a840daac-kube-api-access-fvtv8\") pod \"b408058e-f89c-4b4a-a3b5-bd06a840daac\" (UID: \"b408058e-f89c-4b4a-a3b5-bd06a840daac\") "
Oct 30 22:25:44.388004 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:44.387876    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b408058e-f89c-4b4a-a3b5-bd06a840daac-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b408058e-f89c-4b4a-a3b5-bd06a840daac-extensions-socket-volume\") pod \"b408058e-f89c-4b4a-a3b5-bd06a840daac\" (UID: \"b408058e-f89c-4b4a-a3b5-bd06a840daac\") "
Oct 30 22:25:44.388281 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:44.388254    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b408058e-f89c-4b4a-a3b5-bd06a840daac-extensions-socket-volume" pod "b408058e-f89c-4b4a-a3b5-bd06a840daac" (UID: "b408058e-f89c-4b4a-a3b5-bd06a840daac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:44.389995 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:44.389957    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b408058e-f89c-4b4a-a3b5-bd06a840daac-kube-api-access-fvtv8" pod "b408058e-f89c-4b4a-a3b5-bd06a840daac" (UID: "b408058e-f89c-4b4a-a3b5-bd06a840daac"). InnerVolumeSpecName "kube-api-access-fvtv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:44.488553 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:44.488523    5575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b408058e-f89c-4b4a-a3b5-bd06a840daac-extensions-socket-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:44.488553 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:44.488552    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvtv8\" (UniqueName: \"kubernetes.io/projected/b408058e-f89c-4b4a-a3b5-bd06a840daac-kube-api-access-fvtv8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:45.042094 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:45.042057    5575 generic.go:356] "Generic (PLEG): container finished" podID="b408058e-f89c-4b4a-a3b5-bd06a840daac" containerID="7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477" exitCode=0
Oct 30 22:25:45.042513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:45.042120    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"
Oct 30 22:25:45.042513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:45.042148    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd" event={"ID":"b408058e-f89c-4b4a-a3b5-bd06a840daac","Type":"ContainerDied","Data":"7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477"}
Oct 30 22:25:45.042513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:45.042223    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd" event={"ID":"b408058e-f89c-4b4a-a3b5-bd06a840daac","Type":"ContainerDied","Data":"5bf28d4738ddefdb7937498b1cf43d4612a94bf59ab952275b8c3752c90fac09"}
Oct 30 22:25:45.042513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:45.042246    5575 scope.go:122] "RemoveContainer" containerID="7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477"
Oct 30 22:25:45.090304 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:45.090285    5575 scope.go:122] "RemoveContainer" containerID="7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477"
Oct 30 22:25:45.090623 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:25:45.090603    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477\": container with ID starting with 7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477 not found: ID does not exist" containerID="7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477"
Oct 30 22:25:45.090684 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:45.090633    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477"} err="failed to get container status \"7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477\": rpc error: code = NotFound desc = could not find container \"7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477\": container with ID starting with 7c57b60dde442255f9c42ee1d0bb6e7df7554bcb6027a89bba0a687188e52477 not found: ID does not exist"
Oct 30 22:25:45.215288 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:45.215263    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"]
Oct 30 22:25:45.265608 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:45.265574    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sdmgd"]
Oct 30 22:25:47.125899 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:25:47.125865    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b408058e-f89c-4b4a-a3b5-bd06a840daac" path="/var/lib/kubelet/pods/b408058e-f89c-4b4a-a3b5-bd06a840daac/volumes"
Oct 30 22:25:53.486074 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:25:53.486039    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:26:02.726932 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:02.726893    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:20.955455 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:20.955418    5575 scope.go:122] "RemoveContainer" containerID="fb25dcc2db7edd2c8520b1aaf91317d2413c7f9ba30a39430fb4efc1c3b32e85"
Oct 30 22:26:20.965286 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:20.965260    5575 scope.go:122] "RemoveContainer" containerID="6befda5993f7592748fc2b5d2017abfbbc4adf66c72392b89b93a6f9ee12b6d9"
Oct 30 22:26:20.974481 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:20.974461    5575 scope.go:122] "RemoveContainer" containerID="575e1981f61f074d704c4d6cd1f5cea9e3e117779e4dc45b31ada0aae8c57a38"
Oct 30 22:26:23.485754 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:26:23.485720    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:26:47.672454 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.672420    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"]
Oct 30 22:26:47.672925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.672877    5575 cpu_manager.go:414] "containerMap: removing container" podUID="8f2acac1-4ee7-473b-aa48-f4c633359b35" containerName="revoke-keys"
Oct 30 22:26:47.672925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.672888    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f2acac1-4ee7-473b-aa48-f4c633359b35" containerName="revoke-keys"
Oct 30 22:26:47.672925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.672902    5575 cpu_manager.go:414] "containerMap: removing container" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy"
Oct 30 22:26:47.672925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.672908    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy"
Oct 30 22:26:47.672925 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.672926    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b408058e-f89c-4b4a-a3b5-bd06a840daac" containerName="manager"
Oct 30 22:26:47.673133 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.672931    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b408058e-f89c-4b4a-a3b5-bd06a840daac" containerName="manager"
Oct 30 22:26:47.673133 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.673009    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f2acac1-4ee7-473b-aa48-f4c633359b35" containerName="revoke-keys"
Oct 30 22:26:47.673133 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.673018    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy"
Oct 30 22:26:47.673133 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.673027    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b408058e-f89c-4b4a-a3b5-bd06a840daac" containerName="manager"
Oct 30 22:26:47.676149 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.676133    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:26:47.727531 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.727506    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"]
Oct 30 22:26:47.758196 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.758173    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bcef66c-cc8c-4494-bea5-3224935c832c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-7rk76\" (UID: \"5bcef66c-cc8c-4494-bea5-3224935c832c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:26:47.758328 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.758309    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxl7s\" (UniqueName: \"kubernetes.io/projected/5bcef66c-cc8c-4494-bea5-3224935c832c-kube-api-access-zxl7s\") pod \"kuadrant-operator-controller-manager-678d87766f-7rk76\" (UID: \"5bcef66c-cc8c-4494-bea5-3224935c832c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:26:47.774363 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.774335    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z6krb\""
Oct 30 22:26:47.859155 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.859128    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxl7s\" (UniqueName: \"kubernetes.io/projected/5bcef66c-cc8c-4494-bea5-3224935c832c-kube-api-access-zxl7s\") pod \"kuadrant-operator-controller-manager-678d87766f-7rk76\" (UID: \"5bcef66c-cc8c-4494-bea5-3224935c832c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:26:47.859255 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.859191    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bcef66c-cc8c-4494-bea5-3224935c832c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-7rk76\" (UID: \"5bcef66c-cc8c-4494-bea5-3224935c832c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:26:47.859505 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.859489    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bcef66c-cc8c-4494-bea5-3224935c832c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-7rk76\" (UID: \"5bcef66c-cc8c-4494-bea5-3224935c832c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:26:47.922713 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.922661    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxl7s\" (UniqueName: \"kubernetes.io/projected/5bcef66c-cc8c-4494-bea5-3224935c832c-kube-api-access-zxl7s\") pod \"kuadrant-operator-controller-manager-678d87766f-7rk76\" (UID: \"5bcef66c-cc8c-4494-bea5-3224935c832c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:26:47.988907 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:47.988885    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:26:48.427635 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:48.427606    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"]
Oct 30 22:26:48.429034 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:26:48.429005    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bcef66c_cc8c_4494_bea5_3224935c832c.slice/crio-cc925b3fb45be2566aa45a2516109dcbaca73dc840ce6adbe17c286268a2d332 WatchSource:0}: Error finding container cc925b3fb45be2566aa45a2516109dcbaca73dc840ce6adbe17c286268a2d332: Status 404 returned error can't find the container with id cc925b3fb45be2566aa45a2516109dcbaca73dc840ce6adbe17c286268a2d332
Oct 30 22:26:48.440663 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:48.440633    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76" event={"ID":"5bcef66c-cc8c-4494-bea5-3224935c832c","Type":"ContainerStarted","Data":"cc925b3fb45be2566aa45a2516109dcbaca73dc840ce6adbe17c286268a2d332"}
Oct 30 22:26:49.449399 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:49.449364    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76" event={"ID":"5bcef66c-cc8c-4494-bea5-3224935c832c","Type":"ContainerStarted","Data":"7ea19279bb5fedf59dcad51569f5918433abeb619dd960f54f0ce72c619acba9"}
Oct 30 22:26:49.449816 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:49.449449    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:26:49.676898 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:49.676821    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76" podStartSLOduration=2.67680439 podStartE2EDuration="2.67680439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:49.62156634 +0000 UTC m=+3810.653414875" watchObservedRunningTime="2026-10-30 22:26:49.67680439 +0000 UTC m=+3810.708652925"
Oct 30 22:26:51.055178 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:51.055143    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"]
Oct 30 22:26:51.105342 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:51.105313    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-69w5k"]
Oct 30 22:26:51.126259 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:51.126230    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5e94810-cde2-458c-934a-be139bafcabe" path="/var/lib/kubelet/pods/b5e94810-cde2-458c-934a-be139bafcabe/volumes"
Oct 30 22:26:53.130446 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:26:53.130410    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:53.489704 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:26:53.489665    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:27:00.457669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:00.457635    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rk76"
Oct 30 22:27:02.053974 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:02.053944    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"]
Oct 30 22:27:02.103893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:02.103861    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-bs4cw"]
Oct 30 22:27:03.101340 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:03.101304    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:03.125648 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:03.125622    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3eac0740-0191-44da-b9ed-2d33f1dde719" path="/var/lib/kubelet/pods/3eac0740-0191-44da-b9ed-2d33f1dde719/volumes"
Oct 30 22:27:03.272154 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:03.272121    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:10.757428 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:10.757376    5575 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-rmjwj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.159:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:27:10.758148 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:10.758089    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.159:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:27:21.009298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.009264    5575 scope.go:122] "RemoveContainer" containerID="31e72e3646262a1895b785b39014a59c19c9d346eb880e0956aefa3773e9a82b"
Oct 30 22:27:21.716801 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.716770    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"]
Oct 30 22:27:21.717263 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.717249    5575 cpu_manager.go:414] "containerMap: removing container" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy"
Oct 30 22:27:21.717317 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.717267    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy"
Oct 30 22:27:21.717369 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.717359    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="0cc79b11-ae90-4fba-860b-296f996e2d7a" containerName="istio-proxy"
Oct 30 22:27:21.721993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.721959    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:21.775992 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.775948    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:27:21.823227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.823202    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-rm9d8\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:21.823360 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.823245    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnfr8\" (UniqueName: \"kubernetes.io/projected/1b8972d7-bced-4dcc-877d-4766118fee04-kube-api-access-jnfr8\") pod \"maas-api-revoke-sub-d576e68b-rm9d8\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:21.823409 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.823353    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-rm9d8\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:21.826003 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.825987    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:27:21.828753 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.828734    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"]
Oct 30 22:27:21.924579 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.924555    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnfr8\" (UniqueName: \"kubernetes.io/projected/1b8972d7-bced-4dcc-877d-4766118fee04-kube-api-access-jnfr8\") pod \"maas-api-revoke-sub-d576e68b-rm9d8\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:21.924704 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.924610    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-rm9d8\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:21.924704 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.924672    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-rm9d8\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:21.925254 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.925238    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-rm9d8\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:21.927106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.927089    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-rm9d8\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:21.985436 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:21.985384    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnfr8\" (UniqueName: \"kubernetes.io/projected/1b8972d7-bced-4dcc-877d-4766118fee04-kube-api-access-jnfr8\") pod \"maas-api-revoke-sub-d576e68b-rm9d8\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:22.035140 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:22.035116    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:22.410295 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:22.410272    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"]
Oct 30 22:27:22.412658 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:27:22.412622    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8972d7_bced_4dcc_877d_4766118fee04.slice/crio-598230757f125796b96c6a6e77c038c7ad65cf6718266fc994a1d70d52f8e453 WatchSource:0}: Error finding container 598230757f125796b96c6a6e77c038c7ad65cf6718266fc994a1d70d52f8e453: Status 404 returned error can't find the container with id 598230757f125796b96c6a6e77c038c7ad65cf6718266fc994a1d70d52f8e453
Oct 30 22:27:22.685584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:22.685520    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8" event={"ID":"1b8972d7-bced-4dcc-877d-4766118fee04","Type":"ContainerStarted","Data":"598230757f125796b96c6a6e77c038c7ad65cf6718266fc994a1d70d52f8e453"}
Oct 30 22:27:23.485858 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:27:23.485817    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:27:23.693525 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:23.693490    5575 generic.go:356] "Generic (PLEG): container finished" podID="1b8972d7-bced-4dcc-877d-4766118fee04" containerID="fc572550ffbbd0126117a67756a5afe945c90334dc155d8d857e976c781c93b4" exitCode=0
Oct 30 22:27:23.693710 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:23.693573    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8" event={"ID":"1b8972d7-bced-4dcc-877d-4766118fee04","Type":"ContainerDied","Data":"fc572550ffbbd0126117a67756a5afe945c90334dc155d8d857e976c781c93b4"}
Oct 30 22:27:24.844568 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:24.844543    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:24.953259 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:24.953188    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b8972d7-bced-4dcc-877d-4766118fee04-kube-api-access-jnfr8\" (UniqueName: \"kubernetes.io/projected/1b8972d7-bced-4dcc-877d-4766118fee04-kube-api-access-jnfr8\") pod \"1b8972d7-bced-4dcc-877d-4766118fee04\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") "
Oct 30 22:27:24.953259 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:24.953235    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-xks-ca\") pod \"1b8972d7-bced-4dcc-877d-4766118fee04\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") "
Oct 30 22:27:24.953430 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:24.953334    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-openshift-ca\") pod \"1b8972d7-bced-4dcc-877d-4766118fee04\" (UID: \"1b8972d7-bced-4dcc-877d-4766118fee04\") "
Oct 30 22:27:24.953778 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:24.953756    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-openshift-ca" pod "1b8972d7-bced-4dcc-877d-4766118fee04" (UID: "1b8972d7-bced-4dcc-877d-4766118fee04"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:27:24.955510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:24.955488    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-xks-ca" pod "1b8972d7-bced-4dcc-877d-4766118fee04" (UID: "1b8972d7-bced-4dcc-877d-4766118fee04"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:27:24.955629 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:24.955611    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b8972d7-bced-4dcc-877d-4766118fee04-kube-api-access-jnfr8" pod "1b8972d7-bced-4dcc-877d-4766118fee04" (UID: "1b8972d7-bced-4dcc-877d-4766118fee04"). InnerVolumeSpecName "kube-api-access-jnfr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:25.054659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:25.054628    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:25.054659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:25.054656    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnfr8\" (UniqueName: \"kubernetes.io/projected/1b8972d7-bced-4dcc-877d-4766118fee04-kube-api-access-jnfr8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:25.054845 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:25.054667    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1b8972d7-bced-4dcc-877d-4766118fee04-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:25.706660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:25.706629    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"
Oct 30 22:27:25.706832 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:25.706635    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8" event={"ID":"1b8972d7-bced-4dcc-877d-4766118fee04","Type":"ContainerDied","Data":"598230757f125796b96c6a6e77c038c7ad65cf6718266fc994a1d70d52f8e453"}
Oct 30 22:27:25.706832 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:25.706757    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="598230757f125796b96c6a6e77c038c7ad65cf6718266fc994a1d70d52f8e453"
Oct 30 22:27:50.866556 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:50.866520    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"]
Oct 30 22:27:50.867412 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:50.867391    5575 cpu_manager.go:414] "containerMap: removing container" podUID="1b8972d7-bced-4dcc-877d-4766118fee04" containerName="revoke-keys"
Oct 30 22:27:50.867412 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:50.867412    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b8972d7-bced-4dcc-877d-4766118fee04" containerName="revoke-keys"
Oct 30 22:27:50.867581 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:50.867538    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b8972d7-bced-4dcc-877d-4766118fee04" containerName="revoke-keys"
Oct 30 22:27:50.870907 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:50.870890    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:50.926101 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:50.926072    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:27:50.926264 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:50.926146    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:27:50.978726 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:50.978699    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"]
Oct 30 22:27:51.008564 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.008536    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b55qr\" (UniqueName: \"kubernetes.io/projected/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-kube-api-access-b55qr\") pod \"maas-api-revoke-sub-d2bc93bc-rb5mr\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.008716 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.008576    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-rb5mr\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.008716 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.008598    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-rb5mr\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.110070 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.110036    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b55qr\" (UniqueName: \"kubernetes.io/projected/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-kube-api-access-b55qr\") pod \"maas-api-revoke-sub-d2bc93bc-rb5mr\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.110274 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.110092    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-rb5mr\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.110369 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.110265    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-rb5mr\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.110832 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.110811    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-rb5mr\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.112644 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.112604    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-rb5mr\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.171777 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.171753    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b55qr\" (UniqueName: \"kubernetes.io/projected/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-kube-api-access-b55qr\") pod \"maas-api-revoke-sub-d2bc93bc-rb5mr\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.183495 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.183475    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:51.571039 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.571016    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"]
Oct 30 22:27:51.572552 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:27:51.572523    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd65d8bd_cbe6_4b8c_9f77_1162bd7746ea.slice/crio-63ae77914f7033a1a9864b6e149c641aafd5d838b751c15d65b025d94c9bc1c3 WatchSource:0}: Error finding container 63ae77914f7033a1a9864b6e149c641aafd5d838b751c15d65b025d94c9bc1c3: Status 404 returned error can't find the container with id 63ae77914f7033a1a9864b6e149c641aafd5d838b751c15d65b025d94c9bc1c3
Oct 30 22:27:51.918020 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:51.917990    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr" event={"ID":"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea","Type":"ContainerStarted","Data":"63ae77914f7033a1a9864b6e149c641aafd5d838b751c15d65b025d94c9bc1c3"}
Oct 30 22:27:52.925418 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:52.925380    5575 generic.go:356] "Generic (PLEG): container finished" podID="cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea" containerID="884f39d5b7f7ebf21426c04a205500890be4ceff56417383be4d074c4e762ca9" exitCode=0
Oct 30 22:27:52.925862 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:52.925467    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr" event={"ID":"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea","Type":"ContainerDied","Data":"884f39d5b7f7ebf21426c04a205500890be4ceff56417383be4d074c4e762ca9"}
Oct 30 22:27:53.485904 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:27:53.485862    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:27:54.072669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.072647    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:54.241624 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.241540    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-xks-ca\") pod \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") "
Oct 30 22:27:54.241624 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.241581    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-openshift-ca\") pod \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") "
Oct 30 22:27:54.241850 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.241670    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-kube-api-access-b55qr\" (UniqueName: \"kubernetes.io/projected/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-kube-api-access-b55qr\") pod \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\" (UID: \"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea\") "
Oct 30 22:27:54.241913 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.241892    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-openshift-ca" pod "cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea" (UID: "cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:27:54.242275 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.242249    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:54.243792 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.243763    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-kube-api-access-b55qr" pod "cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea" (UID: "cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea"). InnerVolumeSpecName "kube-api-access-b55qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:54.243792 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.243784    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-xks-ca" pod "cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea" (UID: "cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:27:54.343210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.343185    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:54.343210 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.343210    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b55qr\" (UniqueName: \"kubernetes.io/projected/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea-kube-api-access-b55qr\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:54.939747 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.939716    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"
Oct 30 22:27:54.939930 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.939745    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr" event={"ID":"cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea","Type":"ContainerDied","Data":"63ae77914f7033a1a9864b6e149c641aafd5d838b751c15d65b025d94c9bc1c3"}
Oct 30 22:27:54.939930 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:27:54.939792    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63ae77914f7033a1a9864b6e149c641aafd5d838b751c15d65b025d94c9bc1c3"
Oct 30 22:28:00.928420 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:00.928289    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:03.475125 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:03.475087    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:04.094888 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.094859    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"]
Oct 30 22:28:04.095337 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.095325    5575 cpu_manager.go:414] "containerMap: removing container" podUID="cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea" containerName="revoke-keys"
Oct 30 22:28:04.095390 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.095339    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea" containerName="revoke-keys"
Oct 30 22:28:04.095426 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.095408    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea" containerName="revoke-keys"
Oct 30 22:28:04.098586 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.098566    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.133691 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.133665    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/617d163e-82cc-47ea-a838-7a899db10d40-istiod-ca-cert\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.133837 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.133706    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-istio-token\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.133837 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.133727    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-credential-socket\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.133931 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.133903    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/617d163e-82cc-47ea-a838-7a899db10d40-istio-podinfo\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.134028 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.134006    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-data\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.134096 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.134053    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7872z\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-kube-api-access-7872z\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.134187 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.134164    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-envoy\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.134242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.134215    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-socket\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.134341 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.134320    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-certs\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.160100 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.160070    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-b24ff0-openshift-default-dockercfg-mcjf5\""
Oct 30 22:28:04.213296 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.213250    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"]
Oct 30 22:28:04.235708 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.235678    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/617d163e-82cc-47ea-a838-7a899db10d40-istiod-ca-cert\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.235869 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.235719    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-istio-token\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.235869 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.235754    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-credential-socket\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.235869 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.235819    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/617d163e-82cc-47ea-a838-7a899db10d40-istio-podinfo\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.235869 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.235850    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-data\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.236100 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.235873    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7872z\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-kube-api-access-7872z\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.236100 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.235904    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-envoy\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.236100 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.235942    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-socket\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.236100 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.236013    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-certs\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.236636 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.236608    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/617d163e-82cc-47ea-a838-7a899db10d40-istiod-ca-cert\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.237000 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.236920    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-credential-socket\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.237000 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.236947    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-certs\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.237000 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.236994    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-data\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.237198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.237057    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-socket\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.239144 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.239122    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/617d163e-82cc-47ea-a838-7a899db10d40-istio-podinfo\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.239422 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.239400    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-envoy\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.320072 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.320037    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-istio-token\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.320950 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.320920    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7872z\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-kube-api-access-7872z\") pod \"e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") " pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.411672 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.411637    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:04.454949 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.454914    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:04.821648 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.821563    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:04.851782 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.851760    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"]
Oct 30 22:28:04.853868 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:28:04.853842    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617d163e_82cc_47ea_a838_7a899db10d40.slice/crio-4025d106baa0c950359a02cd62de854974937a7f8201562a4d120b0c7da3e329 WatchSource:0}: Error finding container 4025d106baa0c950359a02cd62de854974937a7f8201562a4d120b0c7da3e329: Status 404 returned error can't find the container with id 4025d106baa0c950359a02cd62de854974937a7f8201562a4d120b0c7da3e329
Oct 30 22:28:04.856161 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.856125    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:04.856267 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.856209    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:04.856267 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:04.856256    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:05.001799 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:05.001763    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" event={"ID":"617d163e-82cc-47ea-a838-7a899db10d40","Type":"ContainerStarted","Data":"25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61"}
Oct 30 22:28:05.002023 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:05.001817    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" event={"ID":"617d163e-82cc-47ea-a838-7a899db10d40","Type":"ContainerStarted","Data":"4025d106baa0c950359a02cd62de854974937a7f8201562a4d120b0c7da3e329"}
Oct 30 22:28:05.127666 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:05.127567    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" podStartSLOduration=1.1275532400000001 podStartE2EDuration="1.12755324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:28:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:28:05.127005392 +0000 UTC m=+3886.158853929" watchObservedRunningTime="2026-10-30 22:28:05.12755324 +0000 UTC m=+3886.159401774"
Oct 30 22:28:05.411881 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:05.411853    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:05.417001 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:05.416951    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:06.008846 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:06.008817    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:06.009848 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:06.009828    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:08.308406 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:08.308371    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:08.660844 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:08.660812    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:11.483954 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:11.483923    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:11.671242 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:11.671210    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:13.187575 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:13.187524    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:14.711289 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:14.711259    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:14.870089 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:14.870057    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:15.029326 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:15.029238    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:19.770135 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:19.770092    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:19.899195 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:19.899164    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:28:19.928789 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:19.928759    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:28:19.951599 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:19.951568    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:28:19.968134 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:19.968112    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:28:21.033898 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:21.033867    5575 scope.go:122] "RemoveContainer" containerID="1d85173fd89abd9af044513d740750ee44e835f72d33db30f401fbd42b5f042e"
Oct 30 22:28:21.043601 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:21.043575    5575 scope.go:122] "RemoveContainer" containerID="86c042dd745229429beb210c6aebbcf2d93881be6f563e514ab41d76ac4aff72"
Oct 30 22:28:21.052320 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:21.052302    5575 scope.go:122] "RemoveContainer" containerID="65526de25d9f520cf49ceef0ada5c53f10010ba644876e65320cda9ed2decd56"
Oct 30 22:28:23.486819 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:28:23.486780    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:28:24.787614 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:24.787582    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:29.807786 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:29.807736    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:32.185409 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:32.185382    5575 generic.go:356] "Generic (PLEG): container finished" podID="617d163e-82cc-47ea-a838-7a899db10d40" containerID="25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61" exitCode=0
Oct 30 22:28:32.185753 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:32.185445    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" event={"ID":"617d163e-82cc-47ea-a838-7a899db10d40","Type":"ContainerDied","Data":"25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61"}
Oct 30 22:28:32.185806 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:32.185793    5575 scope.go:122] "RemoveContainer" containerID="25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61"
Oct 30 22:28:32.186980 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:32.186937    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:32.187047 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:32.187030    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:32.187085 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:32.187064    5575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:33.194162 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:33.194129    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" event={"ID":"617d163e-82cc-47ea-a838-7a899db10d40","Type":"ContainerStarted","Data":"4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33"}
Oct 30 22:28:33.431317 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:33.431269    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:33.432451 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:33.432418    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused" start-of-body=
Oct 30 22:28:33.432580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:33.432481    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused"
Oct 30 22:28:34.419322 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:34.419288    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused" start-of-body=
Oct 30 22:28:34.419924 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:34.419885    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused"
Oct 30 22:28:34.985250 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:34.985218    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:35.412578 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:35.412544    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused" start-of-body=
Oct 30 22:28:35.412871 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:35.412844    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused"
Oct 30 22:28:36.011004 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:36.010069    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:36.427317 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:36.427283    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused" start-of-body=
Oct 30 22:28:36.427607 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:36.427576    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused"
Oct 30 22:28:37.425993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:37.423666    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused" start-of-body=
Oct 30 22:28:37.425993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:37.423723    5575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.182:15021/healthz/ready\": dial tcp 10.132.0.182:15021: connect: connection refused"
Oct 30 22:28:38.416322 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:38.416293    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:38.417344 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:38.417323    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:28:39.862731 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:39.862697    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:43.110026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:43.109991    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:43.747550 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:43.747513    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:43.915343 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:43.915308    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:44.108029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:44.107913    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:44.800635 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:44.800592    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:47.541036 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:47.540991    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:49.775126 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:49.775088    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:53.486256 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:28:53.486223    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:28:54.862779 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:54.862743    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:59.822412 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:28:59.822370    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:03.799493 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:03.799457    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:04.678090 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:04.678058    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:09.571627 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:09.571589    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:14.578221 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:14.578176    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:19.490482 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:19.490447    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:22.085385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:22.085349    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"]
Oct 30 22:29:22.135096 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:22.135066    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d47848f6-5lqvn"]
Oct 30 22:29:23.126068 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:23.126026    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16b568a9-918d-4694-8c56-3a2a3c4209c8" path="/var/lib/kubelet/pods/16b568a9-918d-4694-8c56-3a2a3c4209c8/volumes"
Oct 30 22:29:23.485004 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:29:23.484938    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:29:24.469105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:24.469064    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:29.403657 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:29.403576    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:34.272877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:34.272831    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:39.088258 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:39.088214    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:42.364207 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.364182    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"]
Oct 30 22:29:42.367822 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.367803    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.426093 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.426059    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"]
Oct 30 22:29:42.472293 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.472265    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:29:42.472429 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.472306    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:29:42.497033 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.497009    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw9z9\" (UniqueName: \"kubernetes.io/projected/2de6c876-4fe2-4248-b737-62bcc2242652-kube-api-access-jw9z9\") pod \"maas-api-revoke-sub-8837b66a-8trvd\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.497173 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.497132    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8837b66a-8trvd\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.497221 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.497195    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8837b66a-8trvd\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.597935 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.597855    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw9z9\" (UniqueName: \"kubernetes.io/projected/2de6c876-4fe2-4248-b737-62bcc2242652-kube-api-access-jw9z9\") pod \"maas-api-revoke-sub-8837b66a-8trvd\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.597935 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.597929    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8837b66a-8trvd\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.598195 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.597951    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8837b66a-8trvd\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.598605 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.598581    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8837b66a-8trvd\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.600446 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.600424    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8837b66a-8trvd\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.659708 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.659682    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw9z9\" (UniqueName: \"kubernetes.io/projected/2de6c876-4fe2-4248-b737-62bcc2242652-kube-api-access-jw9z9\") pod \"maas-api-revoke-sub-8837b66a-8trvd\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:42.680426 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:42.680398    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:43.053943 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:43.053907    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"]
Oct 30 22:29:43.055586 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:29:43.055558    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de6c876_4fe2_4248_b737_62bcc2242652.slice/crio-6af34e4de18b6e0b95ca68c0efeaf3cbeff77f8c54275206390fceefea149056 WatchSource:0}: Error finding container 6af34e4de18b6e0b95ca68c0efeaf3cbeff77f8c54275206390fceefea149056: Status 404 returned error can't find the container with id 6af34e4de18b6e0b95ca68c0efeaf3cbeff77f8c54275206390fceefea149056
Oct 30 22:29:43.684842 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:43.684807    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd" event={"ID":"2de6c876-4fe2-4248-b737-62bcc2242652","Type":"ContainerStarted","Data":"c9d1051a4c277034e00f22e3c35916c75d41d60c3fe45a423277181d35c68523"}
Oct 30 22:29:43.685240 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:43.684855    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd" event={"ID":"2de6c876-4fe2-4248-b737-62bcc2242652","Type":"ContainerStarted","Data":"6af34e4de18b6e0b95ca68c0efeaf3cbeff77f8c54275206390fceefea149056"}
Oct 30 22:29:43.802134 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:43.802084    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd" podStartSLOduration=1.802070847 podStartE2EDuration="1.802070847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:29:43.799662484 +0000 UTC m=+3984.831511042" watchObservedRunningTime="2026-10-30 22:29:43.802070847 +0000 UTC m=+3984.833919416"
Oct 30 22:29:43.964092 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:43.963992    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:44.694717 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:44.694678    5575 generic.go:356] "Generic (PLEG): container finished" podID="2de6c876-4fe2-4248-b737-62bcc2242652" containerID="c9d1051a4c277034e00f22e3c35916c75d41d60c3fe45a423277181d35c68523" exitCode=0
Oct 30 22:29:44.695176 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:44.694763    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd" event={"ID":"2de6c876-4fe2-4248-b737-62bcc2242652","Type":"ContainerDied","Data":"c9d1051a4c277034e00f22e3c35916c75d41d60c3fe45a423277181d35c68523"}
Oct 30 22:29:45.848299 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:45.848267    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:45.930147 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:45.930114    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2de6c876-4fe2-4248-b737-62bcc2242652-kube-api-access-jw9z9\" (UniqueName: \"kubernetes.io/projected/2de6c876-4fe2-4248-b737-62bcc2242652-kube-api-access-jw9z9\") pod \"2de6c876-4fe2-4248-b737-62bcc2242652\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") "
Oct 30 22:29:45.930282 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:45.930232    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-openshift-ca\") pod \"2de6c876-4fe2-4248-b737-62bcc2242652\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") "
Oct 30 22:29:45.930374 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:45.930357    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-xks-ca\") pod \"2de6c876-4fe2-4248-b737-62bcc2242652\" (UID: \"2de6c876-4fe2-4248-b737-62bcc2242652\") "
Oct 30 22:29:45.930638 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:45.930610    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-openshift-ca" pod "2de6c876-4fe2-4248-b737-62bcc2242652" (UID: "2de6c876-4fe2-4248-b737-62bcc2242652"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:45.930732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:45.930708    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:45.932427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:45.932406    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de6c876-4fe2-4248-b737-62bcc2242652-kube-api-access-jw9z9" pod "2de6c876-4fe2-4248-b737-62bcc2242652" (UID: "2de6c876-4fe2-4248-b737-62bcc2242652"). InnerVolumeSpecName "kube-api-access-jw9z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:45.932596 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:45.932576    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-xks-ca" pod "2de6c876-4fe2-4248-b737-62bcc2242652" (UID: "2de6c876-4fe2-4248-b737-62bcc2242652"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:29:46.031554 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:46.031477    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2de6c876-4fe2-4248-b737-62bcc2242652-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:46.031554 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:46.031507    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw9z9\" (UniqueName: \"kubernetes.io/projected/2de6c876-4fe2-4248-b737-62bcc2242652-kube-api-access-jw9z9\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:46.709150 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:46.709120    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"
Oct 30 22:29:46.709334 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:46.709153    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd" event={"ID":"2de6c876-4fe2-4248-b737-62bcc2242652","Type":"ContainerDied","Data":"6af34e4de18b6e0b95ca68c0efeaf3cbeff77f8c54275206390fceefea149056"}
Oct 30 22:29:46.709334 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:46.709199    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6af34e4de18b6e0b95ca68c0efeaf3cbeff77f8c54275206390fceefea149056"
Oct 30 22:29:48.883764 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:48.883718    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:53.486693 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:29:53.486657    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:29:53.543174 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:53.543142    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:53.777544 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:53.777460    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:54.104733 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.104656    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"]
Oct 30 22:29:54.105172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.105159    5575 cpu_manager.go:414] "containerMap: removing container" podUID="2de6c876-4fe2-4248-b737-62bcc2242652" containerName="revoke-keys"
Oct 30 22:29:54.105222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.105174    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2de6c876-4fe2-4248-b737-62bcc2242652" containerName="revoke-keys"
Oct 30 22:29:54.105266 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.105262    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="2de6c876-4fe2-4248-b737-62bcc2242652" containerName="revoke-keys"
Oct 30 22:29:54.108484 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.108468    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.166257 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.166225    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"]
Oct 30 22:29:54.208912 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.208883    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7rjf\" (UniqueName: \"kubernetes.io/projected/127b4397-6c4e-4beb-b652-4afc9ecc26e9-kube-api-access-c7rjf\") pod \"maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.209119 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.209029    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.209119 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.209080    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.212594 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.212568    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:29:54.212716 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.212631    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:29:54.310143 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.310111    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7rjf\" (UniqueName: \"kubernetes.io/projected/127b4397-6c4e-4beb-b652-4afc9ecc26e9-kube-api-access-c7rjf\") pod \"maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.310316 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.310162    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.310316 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.310191    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.310855 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.310836    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.312667 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.312637    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.372168 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.372114    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7rjf\" (UniqueName: \"kubernetes.io/projected/127b4397-6c4e-4beb-b652-4afc9ecc26e9-kube-api-access-c7rjf\") pod \"maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.422160 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.422130    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:54.800328 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:54.800298    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"]
Oct 30 22:29:54.801304 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:29:54.801273    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127b4397_6c4e_4beb_b652_4afc9ecc26e9.slice/crio-34998c2b9d27dfca165eca1fd3407d18a6cc5d5c12210aa756f4943fd6d3a96a WatchSource:0}: Error finding container 34998c2b9d27dfca165eca1fd3407d18a6cc5d5c12210aa756f4943fd6d3a96a: Status 404 returned error can't find the container with id 34998c2b9d27dfca165eca1fd3407d18a6cc5d5c12210aa756f4943fd6d3a96a
Oct 30 22:29:55.765913 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:55.765884    5575 generic.go:356] "Generic (PLEG): container finished" podID="127b4397-6c4e-4beb-b652-4afc9ecc26e9" containerID="7a6f43f0a8ffadb5cbd590c5b52277a20450ac72b6f9b14c3e0c4096b6dfca8e" exitCode=0
Oct 30 22:29:55.766108 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:55.765988    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn" event={"ID":"127b4397-6c4e-4beb-b652-4afc9ecc26e9","Type":"ContainerDied","Data":"7a6f43f0a8ffadb5cbd590c5b52277a20450ac72b6f9b14c3e0c4096b6dfca8e"}
Oct 30 22:29:55.766108 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:55.766042    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn" event={"ID":"127b4397-6c4e-4beb-b652-4afc9ecc26e9","Type":"ContainerStarted","Data":"34998c2b9d27dfca165eca1fd3407d18a6cc5d5c12210aa756f4943fd6d3a96a"}
Oct 30 22:29:56.920109 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:56.920081    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:57.040584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.040510    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/127b4397-6c4e-4beb-b652-4afc9ecc26e9-kube-api-access-c7rjf\" (UniqueName: \"kubernetes.io/projected/127b4397-6c4e-4beb-b652-4afc9ecc26e9-kube-api-access-c7rjf\") pod \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") "
Oct 30 22:29:57.040748 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.040633    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-openshift-ca\") pod \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") "
Oct 30 22:29:57.040825 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.040789    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-xks-ca\") pod \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\" (UID: \"127b4397-6c4e-4beb-b652-4afc9ecc26e9\") "
Oct 30 22:29:57.041021 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.040996    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-openshift-ca" pod "127b4397-6c4e-4beb-b652-4afc9ecc26e9" (UID: "127b4397-6c4e-4beb-b652-4afc9ecc26e9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:57.041229 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.041200    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:57.043172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.043140    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-xks-ca" pod "127b4397-6c4e-4beb-b652-4afc9ecc26e9" (UID: "127b4397-6c4e-4beb-b652-4afc9ecc26e9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:29:57.043278 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.043148    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127b4397-6c4e-4beb-b652-4afc9ecc26e9-kube-api-access-c7rjf" pod "127b4397-6c4e-4beb-b652-4afc9ecc26e9" (UID: "127b4397-6c4e-4beb-b652-4afc9ecc26e9"). InnerVolumeSpecName "kube-api-access-c7rjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:57.142033 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.142008    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/127b4397-6c4e-4beb-b652-4afc9ecc26e9-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:57.142033 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.142034    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7rjf\" (UniqueName: \"kubernetes.io/projected/127b4397-6c4e-4beb-b652-4afc9ecc26e9-kube-api-access-c7rjf\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:57.779343 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.779311    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"
Oct 30 22:29:57.779522 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.779339    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn" event={"ID":"127b4397-6c4e-4beb-b652-4afc9ecc26e9","Type":"ContainerDied","Data":"34998c2b9d27dfca165eca1fd3407d18a6cc5d5c12210aa756f4943fd6d3a96a"}
Oct 30 22:29:57.779522 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:57.779388    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34998c2b9d27dfca165eca1fd3407d18a6cc5d5c12210aa756f4943fd6d3a96a"
Oct 30 22:29:58.583389 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:58.583356    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:59.108353 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:29:59.108321    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:00.175919 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.172360    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"]
Oct 30 22:30:00.175919 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.173525    5575 cpu_manager.go:414] "containerMap: removing container" podUID="127b4397-6c4e-4beb-b652-4afc9ecc26e9" containerName="revoke-keys"
Oct 30 22:30:00.175919 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.173549    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="127b4397-6c4e-4beb-b652-4afc9ecc26e9" containerName="revoke-keys"
Oct 30 22:30:00.175919 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.173781    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="127b4397-6c4e-4beb-b652-4afc9ecc26e9" containerName="revoke-keys"
Oct 30 22:30:00.178341 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.178309    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:00.233427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.233390    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"]
Oct 30 22:30:00.270384 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.270348    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q5w8\" (UniqueName: \"kubernetes.io/projected/3ef90245-b761-4466-ae90-5af113dc261b-kube-api-access-7q5w8\") pod \"maas-api-key-cleanup-29889990-4jmtz\" (UID: \"3ef90245-b761-4466-ae90-5af113dc261b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:00.270556 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.270501    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef90245-b761-4466-ae90-5af113dc261b-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889990-4jmtz\" (UID: \"3ef90245-b761-4466-ae90-5af113dc261b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:00.279676 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.279641    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:30:00.371315 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.371283    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef90245-b761-4466-ae90-5af113dc261b-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889990-4jmtz\" (UID: \"3ef90245-b761-4466-ae90-5af113dc261b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:00.371503 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.371386    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q5w8\" (UniqueName: \"kubernetes.io/projected/3ef90245-b761-4466-ae90-5af113dc261b-kube-api-access-7q5w8\") pod \"maas-api-key-cleanup-29889990-4jmtz\" (UID: \"3ef90245-b761-4466-ae90-5af113dc261b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:00.371944 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.371924    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef90245-b761-4466-ae90-5af113dc261b-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889990-4jmtz\" (UID: \"3ef90245-b761-4466-ae90-5af113dc261b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:00.434517 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.434447    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q5w8\" (UniqueName: \"kubernetes.io/projected/3ef90245-b761-4466-ae90-5af113dc261b-kube-api-access-7q5w8\") pod \"maas-api-key-cleanup-29889990-4jmtz\" (UID: \"3ef90245-b761-4466-ae90-5af113dc261b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:00.492026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.491994    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:00.866460 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:00.866429    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"]
Oct 30 22:30:00.867852 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:30:00.867821    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef90245_b761_4466_ae90_5af113dc261b.slice/crio-2fd76341bc8673a3e9433dcf1f270b38788b23cf98bbc0d2fae80fd474169f44 WatchSource:0}: Error finding container 2fd76341bc8673a3e9433dcf1f270b38788b23cf98bbc0d2fae80fd474169f44: Status 404 returned error can't find the container with id 2fd76341bc8673a3e9433dcf1f270b38788b23cf98bbc0d2fae80fd474169f44
Oct 30 22:30:01.806216 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:01.806183    5575 generic.go:356] "Generic (PLEG): container finished" podID="3ef90245-b761-4466-ae90-5af113dc261b" containerID="5881bbf20474a056e9923ff418c906b58be9046665a8be3209639ac549b2d727" exitCode=60
Oct 30 22:30:01.806598 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:01.806265    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" event={"ID":"3ef90245-b761-4466-ae90-5af113dc261b","Type":"ContainerDied","Data":"5881bbf20474a056e9923ff418c906b58be9046665a8be3209639ac549b2d727"}
Oct 30 22:30:01.806598 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:01.806326    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" event={"ID":"3ef90245-b761-4466-ae90-5af113dc261b","Type":"ContainerStarted","Data":"2fd76341bc8673a3e9433dcf1f270b38788b23cf98bbc0d2fae80fd474169f44"}
Oct 30 22:30:01.806598 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:01.806482    5575 scope.go:122] "RemoveContainer" containerID="5881bbf20474a056e9923ff418c906b58be9046665a8be3209639ac549b2d727"
Oct 30 22:30:02.816949 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:02.816865    5575 generic.go:356] "Generic (PLEG): container finished" podID="3ef90245-b761-4466-ae90-5af113dc261b" containerID="b8a3a0574edd7f5fc7cc477c52c3049a72a417c3a9e51e380b207805ef2fa0fd" exitCode=60
Oct 30 22:30:02.816949 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:02.816894    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" event={"ID":"3ef90245-b761-4466-ae90-5af113dc261b","Type":"ContainerDied","Data":"b8a3a0574edd7f5fc7cc477c52c3049a72a417c3a9e51e380b207805ef2fa0fd"}
Oct 30 22:30:02.817427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:02.816989    5575 scope.go:122] "RemoveContainer" containerID="5881bbf20474a056e9923ff418c906b58be9046665a8be3209639ac549b2d727"
Oct 30 22:30:02.817427 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:02.817265    5575 scope.go:122] "RemoveContainer" containerID="b8a3a0574edd7f5fc7cc477c52c3049a72a417c3a9e51e380b207805ef2fa0fd"
Oct 30 22:30:02.817565 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:30:02.817540    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889990-4jmtz_odh-ai-gateway-infra(3ef90245-b761-4466-ae90-5af113dc261b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" podUID="3ef90245-b761-4466-ae90-5af113dc261b"
Oct 30 22:30:03.825126 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:03.825100    5575 scope.go:122] "RemoveContainer" containerID="b8a3a0574edd7f5fc7cc477c52c3049a72a417c3a9e51e380b207805ef2fa0fd"
Oct 30 22:30:03.825521 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:30:03.825306    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889990-4jmtz_odh-ai-gateway-infra(3ef90245-b761-4466-ae90-5af113dc261b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" podUID="3ef90245-b761-4466-ae90-5af113dc261b"
Oct 30 22:30:03.978889 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:03.978858    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:04.162322 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:04.162289    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:04.314130 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:04.314099    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:05.984739 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:05.984700    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:06.145937 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:06.145900    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:08.785269 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:08.785234    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:12.048646 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:12.048602    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"]
Oct 30 22:30:12.098337 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:12.098306    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-lt8x9"]
Oct 30 22:30:13.054004 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:13.053951    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:13.125701 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:13.125665    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f2acac1-4ee7-473b-aa48-f4c633359b35" path="/var/lib/kubelet/pods/8f2acac1-4ee7-473b-aa48-f4c633359b35/volumes"
Oct 30 22:30:14.819581 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:14.819542    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:15.143455 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:15.143425    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:15.416141 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:15.416059    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"]
Oct 30 22:30:15.463729 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:15.463690    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-b24ff0-2wdrn"]
Oct 30 22:30:15.933868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:15.933836    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:17.119470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:17.119442    5575 scope.go:122] "RemoveContainer" containerID="b8a3a0574edd7f5fc7cc477c52c3049a72a417c3a9e51e380b207805ef2fa0fd"
Oct 30 22:30:17.132987 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:17.132944    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="127b4397-6c4e-4beb-b652-4afc9ecc26e9" path="/var/lib/kubelet/pods/127b4397-6c4e-4beb-b652-4afc9ecc26e9/volumes"
Oct 30 22:30:17.912816 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:17.912784    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" event={"ID":"3ef90245-b761-4466-ae90-5af113dc261b","Type":"ContainerStarted","Data":"7ed6316990697006659e5c224f0a129b85c6ddb518b02b2d1b05fc8700794af3"}
Oct 30 22:30:18.030910 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:18.030866    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" podStartSLOduration=18.030852501 podStartE2EDuration="18.030852501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:18.028650719 +0000 UTC m=+4019.060499255" watchObservedRunningTime="2026-10-30 22:30:18.030852501 +0000 UTC m=+4019.062701036"
Oct 30 22:30:18.920741 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:18.920705    5575 generic.go:356] "Generic (PLEG): container finished" podID="3ef90245-b761-4466-ae90-5af113dc261b" containerID="7ed6316990697006659e5c224f0a129b85c6ddb518b02b2d1b05fc8700794af3" exitCode=60
Oct 30 22:30:18.921219 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:18.920758    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" event={"ID":"3ef90245-b761-4466-ae90-5af113dc261b","Type":"ContainerDied","Data":"7ed6316990697006659e5c224f0a129b85c6ddb518b02b2d1b05fc8700794af3"}
Oct 30 22:30:18.921219 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:18.920815    5575 scope.go:122] "RemoveContainer" containerID="b8a3a0574edd7f5fc7cc477c52c3049a72a417c3a9e51e380b207805ef2fa0fd"
Oct 30 22:30:18.921219 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:18.921120    5575 scope.go:122] "RemoveContainer" containerID="7ed6316990697006659e5c224f0a129b85c6ddb518b02b2d1b05fc8700794af3"
Oct 30 22:30:18.921394 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:30:18.921356    5575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29889990-4jmtz_odh-ai-gateway-infra(3ef90245-b761-4466-ae90-5af113dc261b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" podUID="3ef90245-b761-4466-ae90-5af113dc261b"
Oct 30 22:30:19.048090 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:19.048060    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"]
Oct 30 22:30:20.075014 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.074986    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:20.181681 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.181614    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ef90245-b761-4466-ae90-5af113dc261b-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef90245-b761-4466-ae90-5af113dc261b-maas-api-service-ca\") pod \"3ef90245-b761-4466-ae90-5af113dc261b\" (UID: \"3ef90245-b761-4466-ae90-5af113dc261b\") "
Oct 30 22:30:20.181681 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.181678    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ef90245-b761-4466-ae90-5af113dc261b-kube-api-access-7q5w8\" (UniqueName: \"kubernetes.io/projected/3ef90245-b761-4466-ae90-5af113dc261b-kube-api-access-7q5w8\") pod \"3ef90245-b761-4466-ae90-5af113dc261b\" (UID: \"3ef90245-b761-4466-ae90-5af113dc261b\") "
Oct 30 22:30:20.182026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.181954    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ef90245-b761-4466-ae90-5af113dc261b-maas-api-service-ca" pod "3ef90245-b761-4466-ae90-5af113dc261b" (UID: "3ef90245-b761-4466-ae90-5af113dc261b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:20.184025 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.184005    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef90245-b761-4466-ae90-5af113dc261b-kube-api-access-7q5w8" pod "3ef90245-b761-4466-ae90-5af113dc261b" (UID: "3ef90245-b761-4466-ae90-5af113dc261b"). InnerVolumeSpecName "kube-api-access-7q5w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:20.282718 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.282685    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef90245-b761-4466-ae90-5af113dc261b-maas-api-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:20.282718 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.282716    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q5w8\" (UniqueName: \"kubernetes.io/projected/3ef90245-b761-4466-ae90-5af113dc261b-kube-api-access-7q5w8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:20.936929 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.936899    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"
Oct 30 22:30:20.936929 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.936918    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz" event={"ID":"3ef90245-b761-4466-ae90-5af113dc261b","Type":"ContainerDied","Data":"2fd76341bc8673a3e9433dcf1f270b38788b23cf98bbc0d2fae80fd474169f44"}
Oct 30 22:30:20.937167 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:20.937006    5575 scope.go:122] "RemoveContainer" containerID="7ed6316990697006659e5c224f0a129b85c6ddb518b02b2d1b05fc8700794af3"
Oct 30 22:30:21.101072 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:21.101037    5575 scope.go:122] "RemoveContainer" containerID="f91fb1dc21a0ecff82fb3b1db5e5a5c0f281a470be3a9f47e0c64153e3bfedce"
Oct 30 22:30:21.101848 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:21.101826    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"]
Oct 30 22:30:21.151454 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:21.151425    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-4jmtz"]
Oct 30 22:30:21.937537 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:21.937500    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:22.147566 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:22.147524    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:22.321175 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:22.321074    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"]
Oct 30 22:30:22.321362 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:22.321282    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy" containerID="cri-o://4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33" gracePeriod=30
Oct 30 22:30:22.331296 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:22.331264    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:23.125532 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:23.125500    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ef90245-b761-4466-ae90-5af113dc261b" path="/var/lib/kubelet/pods/3ef90245-b761-4466-ae90-5af113dc261b/volumes"
Oct 30 22:30:23.418795 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:23.418757    5575 patch_prober.go:29] interesting pod/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:30:23.419277 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:23.418820    5575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:30:23.487071 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:30:23.487035    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:30:27.577060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.577032    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:30:27.655186 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655158    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/617d163e-82cc-47ea-a838-7a899db10d40-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/617d163e-82cc-47ea-a838-7a899db10d40-istiod-ca-cert\") pod \"617d163e-82cc-47ea-a838-7a899db10d40\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") "
Oct 30 22:30:27.655320 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655208    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-credential-socket\") pod \"617d163e-82cc-47ea-a838-7a899db10d40\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") "
Oct 30 22:30:27.655320 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655285    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-kube-api-access-7872z\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-kube-api-access-7872z\") pod \"617d163e-82cc-47ea-a838-7a899db10d40\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") "
Oct 30 22:30:27.655424 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655352    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-istio-token\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-istio-token\") pod \"617d163e-82cc-47ea-a838-7a899db10d40\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") "
Oct 30 22:30:27.655424 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655402    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/617d163e-82cc-47ea-a838-7a899db10d40-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/617d163e-82cc-47ea-a838-7a899db10d40-istio-podinfo\") pod \"617d163e-82cc-47ea-a838-7a899db10d40\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") "
Oct 30 22:30:27.655538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655430    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-certs\") pod \"617d163e-82cc-47ea-a838-7a899db10d40\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") "
Oct 30 22:30:27.655538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655466    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-socket\") pod \"617d163e-82cc-47ea-a838-7a899db10d40\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") "
Oct 30 22:30:27.655538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655497    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-envoy\") pod \"617d163e-82cc-47ea-a838-7a899db10d40\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") "
Oct 30 22:30:27.655699 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655530    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-credential-socket" pod "617d163e-82cc-47ea-a838-7a899db10d40" (UID: "617d163e-82cc-47ea-a838-7a899db10d40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:27.655699 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655548    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/617d163e-82cc-47ea-a838-7a899db10d40-istiod-ca-cert" pod "617d163e-82cc-47ea-a838-7a899db10d40" (UID: "617d163e-82cc-47ea-a838-7a899db10d40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:27.655699 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655556    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-data\") pod \"617d163e-82cc-47ea-a838-7a899db10d40\" (UID: \"617d163e-82cc-47ea-a838-7a899db10d40\") "
Oct 30 22:30:27.655869 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655773    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-socket" pod "617d163e-82cc-47ea-a838-7a899db10d40" (UID: "617d163e-82cc-47ea-a838-7a899db10d40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:27.655869 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.655783    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-data" pod "617d163e-82cc-47ea-a838-7a899db10d40" (UID: "617d163e-82cc-47ea-a838-7a899db10d40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:27.656067 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.656033    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-certs" pod "617d163e-82cc-47ea-a838-7a899db10d40" (UID: "617d163e-82cc-47ea-a838-7a899db10d40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:27.656308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.656113    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:27.656308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.656136    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:27.656308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.656150    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:27.656308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.656158    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/617d163e-82cc-47ea-a838-7a899db10d40-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:27.656308 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.656166    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:27.657837 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.657813    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-kube-api-access-7872z" pod "617d163e-82cc-47ea-a838-7a899db10d40" (UID: "617d163e-82cc-47ea-a838-7a899db10d40"). InnerVolumeSpecName "kube-api-access-7872z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:27.657927 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.657845    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-istio-token" pod "617d163e-82cc-47ea-a838-7a899db10d40" (UID: "617d163e-82cc-47ea-a838-7a899db10d40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:27.658086 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.658067    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-envoy" pod "617d163e-82cc-47ea-a838-7a899db10d40" (UID: "617d163e-82cc-47ea-a838-7a899db10d40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:27.658155 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.658096    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/617d163e-82cc-47ea-a838-7a899db10d40-istio-podinfo" pod "617d163e-82cc-47ea-a838-7a899db10d40" (UID: "617d163e-82cc-47ea-a838-7a899db10d40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:30:27.757557 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.757528    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/617d163e-82cc-47ea-a838-7a899db10d40-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:27.757663 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.757562    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/617d163e-82cc-47ea-a838-7a899db10d40-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:27.757663 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.757578    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7872z\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-kube-api-access-7872z\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:27.757663 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.757593    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/617d163e-82cc-47ea-a838-7a899db10d40-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:27.981863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.981789    5575 generic.go:356] "Generic (PLEG): container finished" podID="617d163e-82cc-47ea-a838-7a899db10d40" containerID="4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33" exitCode=0
Oct 30 22:30:27.981863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.981844    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"
Oct 30 22:30:27.982078 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.981870    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" event={"ID":"617d163e-82cc-47ea-a838-7a899db10d40","Type":"ContainerDied","Data":"4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33"}
Oct 30 22:30:27.982078 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.981923    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb" event={"ID":"617d163e-82cc-47ea-a838-7a899db10d40","Type":"ContainerDied","Data":"4025d106baa0c950359a02cd62de854974937a7f8201562a4d120b0c7da3e329"}
Oct 30 22:30:27.982078 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.981944    5575 scope.go:122] "RemoveContainer" containerID="4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33"
Oct 30 22:30:27.992879 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:27.992863    5575 scope.go:122] "RemoveContainer" containerID="25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61"
Oct 30 22:30:28.001575 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:28.001557    5575 scope.go:122] "RemoveContainer" containerID="4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33"
Oct 30 22:30:28.001812 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:30:28.001793    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33\": container with ID starting with 4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33 not found: ID does not exist" containerID="4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33"
Oct 30 22:30:28.001893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:28.001823    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33"} err="failed to get container status \"4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33\": rpc error: code = NotFound desc = could not find container \"4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33\": container with ID starting with 4a8a037d8012ea94d95c75d3accfbc224e967c676826619db88be4f6d7092d33 not found: ID does not exist"
Oct 30 22:30:28.001893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:28.001849    5575 scope.go:122] "RemoveContainer" containerID="25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61"
Oct 30 22:30:28.002134 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:30:28.002116    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61\": container with ID starting with 25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61 not found: ID does not exist" containerID="25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61"
Oct 30 22:30:28.002179 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:28.002142    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61"} err="failed to get container status \"25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61\": rpc error: code = NotFound desc = could not find container \"25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61\": container with ID starting with 25e6a5d3b4b3d16ebaa0b6192f6d141632da091edb70e728a4b4a36a14c65a61 not found: ID does not exist"
Oct 30 22:30:28.148742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:28.148706    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"]
Oct 30 22:30:28.198568 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:28.198544    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-b24ff0-openshift-default-99c44787c-hvjrb"]
Oct 30 22:30:29.126005 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:29.125950    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="617d163e-82cc-47ea-a838-7a899db10d40" path="/var/lib/kubelet/pods/617d163e-82cc-47ea-a838-7a899db10d40/volumes"
Oct 30 22:30:35.142277 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:35.142245    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:35.382380 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:35.382351    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:36.218956 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:36.218922    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:42.055454 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:42.055413    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:53.485486 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:30:53.485446    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:30:56.625630 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:30:56.625600    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:04.590054 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:04.589140    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:21.134220 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.134188    5575 scope.go:122] "RemoveContainer" containerID="81dd3c3c70f64d1777ada74f879f0bb3b2f66e840d4b3e5fbf3714c24387cd29"
Oct 30 22:31:21.143726 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.143705    5575 scope.go:122] "RemoveContainer" containerID="eff62c6243ee7d840027fe26a3f97869488634a3adeea5f1cc8dceeb5817b882"
Oct 30 22:31:21.225596 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.225558    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"]
Oct 30 22:31:21.226070 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226053    5575 cpu_manager.go:414] "containerMap: removing container" podUID="3ef90245-b761-4466-ae90-5af113dc261b" containerName="cleanup"
Oct 30 22:31:21.226153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226071    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ef90245-b761-4466-ae90-5af113dc261b" containerName="cleanup"
Oct 30 22:31:21.226153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226090    5575 cpu_manager.go:414] "containerMap: removing container" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy"
Oct 30 22:31:21.226153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226095    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy"
Oct 30 22:31:21.226153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226105    5575 cpu_manager.go:414] "containerMap: removing container" podUID="3ef90245-b761-4466-ae90-5af113dc261b" containerName="cleanup"
Oct 30 22:31:21.226153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226109    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ef90245-b761-4466-ae90-5af113dc261b" containerName="cleanup"
Oct 30 22:31:21.226153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226137    5575 cpu_manager.go:414] "containerMap: removing container" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy"
Oct 30 22:31:21.226153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226142    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy"
Oct 30 22:31:21.226506 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226212    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy"
Oct 30 22:31:21.226506 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226220    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ef90245-b761-4466-ae90-5af113dc261b" containerName="cleanup"
Oct 30 22:31:21.226506 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226227    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ef90245-b761-4466-ae90-5af113dc261b" containerName="cleanup"
Oct 30 22:31:21.226506 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.226233    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ef90245-b761-4466-ae90-5af113dc261b" containerName="cleanup"
Oct 30 22:31:21.231070 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.231054    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.330387 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.330355    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:21.334774 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.334751    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-eb49cee1-kserve-self-signed-certs\""
Oct 30 22:31:21.336153 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.336127    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-model-cache\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.336263 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.336171    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbnxc\" (UniqueName: \"kubernetes.io/projected/1b083b9f-247f-49f3-955b-37b6f41d90f3-kube-api-access-kbnxc\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.336263 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.336248    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b083b9f-247f-49f3-955b-37b6f41d90f3-tls-certs\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.336378 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.336278    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-tmp-dir\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.336436 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.336375    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-dshm\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.336436 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.336412    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-home\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.337580 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.337559    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"]
Oct 30 22:31:21.437641 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.437557    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-dshm\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.437641 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.437610    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-home\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.437865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.437671    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-model-cache\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.437865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.437711    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbnxc\" (UniqueName: \"kubernetes.io/projected/1b083b9f-247f-49f3-955b-37b6f41d90f3-kube-api-access-kbnxc\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.437865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.437751    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b083b9f-247f-49f3-955b-37b6f41d90f3-tls-certs\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.437865 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.437783    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-tmp-dir\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.438119 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.438099    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-home\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.438188 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.438139    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-model-cache\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.438256 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.438200    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-tmp-dir\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.440148 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.440126    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-dshm\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.440610 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.440573    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b083b9f-247f-49f3-955b-37b6f41d90f3-tls-certs\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.499633 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.499606    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbnxc\" (UniqueName: \"kubernetes.io/projected/1b083b9f-247f-49f3-955b-37b6f41d90f3-kube-api-access-kbnxc\") pod \"e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") " pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.543006 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.542952    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:21.926713 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:21.926686    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"]
Oct 30 22:31:21.928271 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:31:21.928243    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b083b9f_247f_49f3_955b_37b6f41d90f3.slice/crio-b3a970b7923fe0063bc480b6342621759fac1da696bc2ddd8d68e14c5a12cb21 WatchSource:0}: Error finding container b3a970b7923fe0063bc480b6342621759fac1da696bc2ddd8d68e14c5a12cb21: Status 404 returned error can't find the container with id b3a970b7923fe0063bc480b6342621759fac1da696bc2ddd8d68e14c5a12cb21
Oct 30 22:31:22.393057 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:22.393017    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt" event={"ID":"1b083b9f-247f-49f3-955b-37b6f41d90f3","Type":"ContainerStarted","Data":"307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa"}
Oct 30 22:31:22.393465 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:22.393069    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt" event={"ID":"1b083b9f-247f-49f3-955b-37b6f41d90f3","Type":"ContainerStarted","Data":"b3a970b7923fe0063bc480b6342621759fac1da696bc2ddd8d68e14c5a12cb21"}
Oct 30 22:31:22.511140 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:22.511093    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt" podStartSLOduration=1.511080489 podStartE2EDuration="1.511080489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:31:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:31:22.510233866 +0000 UTC m=+4083.542082402" watchObservedRunningTime="2026-10-30 22:31:22.511080489 +0000 UTC m=+4083.542929023"
Oct 30 22:31:22.543960 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:22.543930    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:23.487924 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:31:23.487889    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:31:31.543061 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:31.543029    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:31.557482 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:31.557455    5575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:32.554274 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:32.554245    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:31:53.487031 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:31:53.486961    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:31:55.984817 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:55.984781    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"]
Oct 30 22:31:55.985330 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:55.985315    5575 cpu_manager.go:414] "containerMap: removing container" podUID="3ef90245-b761-4466-ae90-5af113dc261b" containerName="cleanup"
Oct 30 22:31:55.985375 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:55.985331    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ef90245-b761-4466-ae90-5af113dc261b" containerName="cleanup"
Oct 30 22:31:55.985439 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:55.985430    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="617d163e-82cc-47ea-a838-7a899db10d40" containerName="istio-proxy"
Oct 30 22:31:55.988649 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:55.988632    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.037869 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.037839    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-2nvlc\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.038033 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.037878    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-2nvlc\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.038033 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.037905    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f6ml\" (UniqueName: \"kubernetes.io/projected/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-kube-api-access-8f6ml\") pod \"maas-api-revoke-sub-452b6d7b-2nvlc\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.091138 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.091105    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:31:56.091138 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.091133    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:31:56.093854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.093831    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"]
Oct 30 22:31:56.138688 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.138653    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-2nvlc\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.138844 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.138720    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f6ml\" (UniqueName: \"kubernetes.io/projected/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-kube-api-access-8f6ml\") pod \"maas-api-revoke-sub-452b6d7b-2nvlc\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.138889 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.138879    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-2nvlc\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.139408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.139380    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-2nvlc\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.141396 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.141376    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-2nvlc\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.200565 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.200533    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f6ml\" (UniqueName: \"kubernetes.io/projected/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-kube-api-access-8f6ml\") pod \"maas-api-revoke-sub-452b6d7b-2nvlc\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.302340 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.302259    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:56.679766 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.679738    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"]
Oct 30 22:31:56.681099 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:31:56.681073    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e526b75_6e7b_4c8d_b3fe_01f5b3f4a0be.slice/crio-aa3ece59a846bf0bb9b1ae5bf4f7a9a41280845bad844f91794db7ec17039328 WatchSource:0}: Error finding container aa3ece59a846bf0bb9b1ae5bf4f7a9a41280845bad844f91794db7ec17039328: Status 404 returned error can't find the container with id aa3ece59a846bf0bb9b1ae5bf4f7a9a41280845bad844f91794db7ec17039328
Oct 30 22:31:56.700679 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:56.700570    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc" event={"ID":"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be","Type":"ContainerStarted","Data":"aa3ece59a846bf0bb9b1ae5bf4f7a9a41280845bad844f91794db7ec17039328"}
Oct 30 22:31:57.708362 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:57.708333    5575 generic.go:356] "Generic (PLEG): container finished" podID="8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be" containerID="82bb241582e5e9cd2a48cbc060aa86ae23b6208d7d4621da6d017be79b6fb0fd" exitCode=0
Oct 30 22:31:57.708684 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:57.708415    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc" event={"ID":"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be","Type":"ContainerDied","Data":"82bb241582e5e9cd2a48cbc060aa86ae23b6208d7d4621da6d017be79b6fb0fd"}
Oct 30 22:31:58.942011 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:58.938758    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:31:59.090560 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.090474    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-openshift-ca\") pod \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") "
Oct 30 22:31:59.101993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.093118    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-xks-ca\") pod \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") "
Oct 30 22:31:59.101993 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.093299    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-kube-api-access-8f6ml\" (UniqueName: \"kubernetes.io/projected/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-kube-api-access-8f6ml\") pod \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\" (UID: \"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be\") "
Oct 30 22:31:59.102601 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.102554    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-openshift-ca" pod "8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be" (UID: "8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:59.152989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.146032    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-xks-ca" pod "8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be" (UID: "8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:59.170017 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.163123    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-kube-api-access-8f6ml" pod "8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be" (UID: "8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be"). InnerVolumeSpecName "kube-api-access-8f6ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:59.243988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.195631    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:59.243988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.195665    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:59.243988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.195687    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f6ml\" (UniqueName: \"kubernetes.io/projected/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be-kube-api-access-8f6ml\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:59.762767 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.762676    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc" event={"ID":"8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be","Type":"ContainerDied","Data":"aa3ece59a846bf0bb9b1ae5bf4f7a9a41280845bad844f91794db7ec17039328"}
Oct 30 22:31:59.763057 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.763034    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa3ece59a846bf0bb9b1ae5bf4f7a9a41280845bad844f91794db7ec17039328"
Oct 30 22:31:59.763284 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:31:59.763269    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"
Oct 30 22:32:04.936077 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:04.936045    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:08.910102 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:08.910070    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:19.615834 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:19.615799    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"]
Oct 30 22:32:19.631453 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:19.631417    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:23.486634 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:32:23.486597    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:32:23.867216 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.867143    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"]
Oct 30 22:32:23.867658 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.867644    5575 cpu_manager.go:414] "containerMap: removing container" podUID="8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be" containerName="revoke-keys"
Oct 30 22:32:23.867729 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.867659    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be" containerName="revoke-keys"
Oct 30 22:32:23.867768 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.867752    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be" containerName="revoke-keys"
Oct 30 22:32:23.871281 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.871258    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:23.901669 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.901639    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-fm2c5\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:23.901824 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.901738    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df7mz\" (UniqueName: \"kubernetes.io/projected/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-kube-api-access-df7mz\") pod \"maas-api-revoke-sub-3e31a506-fm2c5\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:23.901824 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.901807    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-fm2c5\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:23.929927 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.929898    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"]
Oct 30 22:32:23.974823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.974793    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:32:23.974823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:23.974816    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:32:24.002423 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:24.002400    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-fm2c5\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:24.002562 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:24.002483    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-fm2c5\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:24.002562 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:24.002510    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df7mz\" (UniqueName: \"kubernetes.io/projected/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-kube-api-access-df7mz\") pod \"maas-api-revoke-sub-3e31a506-fm2c5\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:24.003318 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:24.003247    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-fm2c5\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:24.005101 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:24.005075    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-fm2c5\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:24.063586 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:24.063549    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df7mz\" (UniqueName: \"kubernetes.io/projected/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-kube-api-access-df7mz\") pod \"maas-api-revoke-sub-3e31a506-fm2c5\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:24.189359 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:24.189330    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:24.571713 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:24.571680    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"]
Oct 30 22:32:24.573128 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:32:24.573090    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b33a2b8_30b6_4b27_a76b_a6e953aa045d.slice/crio-c4eb529e0f22fa2e963b57fe74f98e997500b138b814682e43c0272c2d2fd9f8 WatchSource:0}: Error finding container c4eb529e0f22fa2e963b57fe74f98e997500b138b814682e43c0272c2d2fd9f8: Status 404 returned error can't find the container with id c4eb529e0f22fa2e963b57fe74f98e997500b138b814682e43c0272c2d2fd9f8
Oct 30 22:32:25.026988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:25.026252    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5" event={"ID":"9b33a2b8-30b6-4b27-a76b-a6e953aa045d","Type":"ContainerStarted","Data":"1e1e723f7a450acf55bc958467aeb92a94403c6158ab00aeae24b1ee1389da3d"}
Oct 30 22:32:25.026988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:25.026322    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5" event={"ID":"9b33a2b8-30b6-4b27-a76b-a6e953aa045d","Type":"ContainerStarted","Data":"c4eb529e0f22fa2e963b57fe74f98e997500b138b814682e43c0272c2d2fd9f8"}
Oct 30 22:32:25.058528 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:25.058489    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"]
Oct 30 22:32:25.108348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:25.108219    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-rm9d8"]
Oct 30 22:32:25.130302 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:25.130267    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b8972d7-bced-4dcc-877d-4766118fee04" path="/var/lib/kubelet/pods/1b8972d7-bced-4dcc-877d-4766118fee04/volumes"
Oct 30 22:32:25.170320 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:25.170258    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5" podStartSLOduration=2.170241389 podStartE2EDuration="2.170241389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:32:25.166800414 +0000 UTC m=+4146.198648950" watchObservedRunningTime="2026-10-30 22:32:25.170241389 +0000 UTC m=+4146.202089924"
Oct 30 22:32:26.062047 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:26.061834    5575 generic.go:356] "Generic (PLEG): container finished" podID="9b33a2b8-30b6-4b27-a76b-a6e953aa045d" containerID="1e1e723f7a450acf55bc958467aeb92a94403c6158ab00aeae24b1ee1389da3d" exitCode=0
Oct 30 22:32:26.072989 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:26.066086    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5" event={"ID":"9b33a2b8-30b6-4b27-a76b-a6e953aa045d","Type":"ContainerDied","Data":"1e1e723f7a450acf55bc958467aeb92a94403c6158ab00aeae24b1ee1389da3d"}
Oct 30 22:32:27.663167 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:27.663109    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:27.823990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:27.823483    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:27.881692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:27.881670    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:27.920512 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:27.920483    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-kube-api-access-df7mz\" (UniqueName: \"kubernetes.io/projected/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-kube-api-access-df7mz\") pod \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") "
Oct 30 22:32:27.920653 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:27.920525    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-openshift-ca\") pod \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") "
Oct 30 22:32:27.920653 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:27.920583    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-xks-ca\") pod \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\" (UID: \"9b33a2b8-30b6-4b27-a76b-a6e953aa045d\") "
Oct 30 22:32:27.921034 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:27.921005    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-openshift-ca" pod "9b33a2b8-30b6-4b27-a76b-a6e953aa045d" (UID: "9b33a2b8-30b6-4b27-a76b-a6e953aa045d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:32:27.922800 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:27.922769    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-kube-api-access-df7mz" pod "9b33a2b8-30b6-4b27-a76b-a6e953aa045d" (UID: "9b33a2b8-30b6-4b27-a76b-a6e953aa045d"). InnerVolumeSpecName "kube-api-access-df7mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:27.922893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:27.922838    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-xks-ca" pod "9b33a2b8-30b6-4b27-a76b-a6e953aa045d" (UID: "9b33a2b8-30b6-4b27-a76b-a6e953aa045d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:32:28.021809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:28.021778    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df7mz\" (UniqueName: \"kubernetes.io/projected/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-kube-api-access-df7mz\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:28.021809 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:28.021806    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:28.022004 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:28.021817    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9b33a2b8-30b6-4b27-a76b-a6e953aa045d-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:28.110567 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:28.110500    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"
Oct 30 22:32:28.110567 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:28.110544    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5" event={"ID":"9b33a2b8-30b6-4b27-a76b-a6e953aa045d","Type":"ContainerDied","Data":"c4eb529e0f22fa2e963b57fe74f98e997500b138b814682e43c0272c2d2fd9f8"}
Oct 30 22:32:28.110732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:28.110590    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4eb529e0f22fa2e963b57fe74f98e997500b138b814682e43c0272c2d2fd9f8"
Oct 30 22:32:34.636632 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.636541    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt" podUID="1b083b9f-247f-49f3-955b-37b6f41d90f3" containerName="main" containerID="cri-o://307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa" gracePeriod=45
Oct 30 22:32:34.897977 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.897906    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:32:34.988213 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988183    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-home\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-home\") pod \"1b083b9f-247f-49f3-955b-37b6f41d90f3\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") "
Oct 30 22:32:34.988393 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988233    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-model-cache\") pod \"1b083b9f-247f-49f3-955b-37b6f41d90f3\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") "
Oct 30 22:32:34.988393 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988264    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-dshm\") pod \"1b083b9f-247f-49f3-955b-37b6f41d90f3\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") "
Oct 30 22:32:34.988393 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988290    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-tmp-dir\") pod \"1b083b9f-247f-49f3-955b-37b6f41d90f3\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") "
Oct 30 22:32:34.988577 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988468    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b083b9f-247f-49f3-955b-37b6f41d90f3-kube-api-access-kbnxc\" (UniqueName: \"kubernetes.io/projected/1b083b9f-247f-49f3-955b-37b6f41d90f3-kube-api-access-kbnxc\") pod \"1b083b9f-247f-49f3-955b-37b6f41d90f3\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") "
Oct 30 22:32:34.988577 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988507    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b083b9f-247f-49f3-955b-37b6f41d90f3-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b083b9f-247f-49f3-955b-37b6f41d90f3-tls-certs\") pod \"1b083b9f-247f-49f3-955b-37b6f41d90f3\" (UID: \"1b083b9f-247f-49f3-955b-37b6f41d90f3\") "
Oct 30 22:32:34.988577 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988482    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-home" pod "1b083b9f-247f-49f3-955b-37b6f41d90f3" (UID: "1b083b9f-247f-49f3-955b-37b6f41d90f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:34.988577 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988518    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-model-cache" pod "1b083b9f-247f-49f3-955b-37b6f41d90f3" (UID: "1b083b9f-247f-49f3-955b-37b6f41d90f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:34.988781 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988584    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-tmp-dir" pod "1b083b9f-247f-49f3-955b-37b6f41d90f3" (UID: "1b083b9f-247f-49f3-955b-37b6f41d90f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:34.988823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988791    5575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-home\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:34.988823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988804    5575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-model-cache\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:34.988823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.988813    5575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-tmp-dir\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:34.990737 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.990709    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b083b9f-247f-49f3-955b-37b6f41d90f3-tls-certs" pod "1b083b9f-247f-49f3-955b-37b6f41d90f3" (UID: "1b083b9f-247f-49f3-955b-37b6f41d90f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:32:34.990845 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.990753    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-dshm" pod "1b083b9f-247f-49f3-955b-37b6f41d90f3" (UID: "1b083b9f-247f-49f3-955b-37b6f41d90f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:34.990845 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:34.990786    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b083b9f-247f-49f3-955b-37b6f41d90f3-kube-api-access-kbnxc" pod "1b083b9f-247f-49f3-955b-37b6f41d90f3" (UID: "1b083b9f-247f-49f3-955b-37b6f41d90f3"). InnerVolumeSpecName "kube-api-access-kbnxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:35.089753 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.089719    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbnxc\" (UniqueName: \"kubernetes.io/projected/1b083b9f-247f-49f3-955b-37b6f41d90f3-kube-api-access-kbnxc\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:35.089900 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.089757    5575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b083b9f-247f-49f3-955b-37b6f41d90f3-tls-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:35.089900 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.089773    5575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b083b9f-247f-49f3-955b-37b6f41d90f3-dshm\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:35.155481 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.155397    5575 generic.go:356] "Generic (PLEG): container finished" podID="1b083b9f-247f-49f3-955b-37b6f41d90f3" containerID="307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa" exitCode=0
Oct 30 22:32:35.155481 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.155447    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"
Oct 30 22:32:35.155700 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.155448    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt" event={"ID":"1b083b9f-247f-49f3-955b-37b6f41d90f3","Type":"ContainerDied","Data":"307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa"}
Oct 30 22:32:35.155700 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.155564    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt" event={"ID":"1b083b9f-247f-49f3-955b-37b6f41d90f3","Type":"ContainerDied","Data":"b3a970b7923fe0063bc480b6342621759fac1da696bc2ddd8d68e14c5a12cb21"}
Oct 30 22:32:35.155700 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.155587    5575 scope.go:122] "RemoveContainer" containerID="307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa"
Oct 30 22:32:35.165837 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.165812    5575 scope.go:122] "RemoveContainer" containerID="307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa"
Oct 30 22:32:35.166146 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:32:35.166127    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa\": container with ID starting with 307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa not found: ID does not exist" containerID="307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa"
Oct 30 22:32:35.166214 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.166155    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa"} err="failed to get container status \"307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa\": rpc error: code = NotFound desc = could not find container \"307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa\": container with ID starting with 307ce89b9e3e159c0ccd402ad4e184acb758383248495e14a8c112c6895465fa not found: ID does not exist"
Oct 30 22:32:35.319846 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.319819    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"]
Oct 30 22:32:35.326228 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:35.326205    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-eb49cee1-kserve-f69b56c65-dv2mt"]
Oct 30 22:32:37.125487 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:37.125446    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b083b9f-247f-49f3-955b-37b6f41d90f3" path="/var/lib/kubelet/pods/1b083b9f-247f-49f3-955b-37b6f41d90f3/volumes"
Oct 30 22:32:53.488027 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:32:53.487990    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:32:53.667823 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.667785    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"]
Oct 30 22:32:53.668330 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.668312    5575 cpu_manager.go:414] "containerMap: removing container" podUID="9b33a2b8-30b6-4b27-a76b-a6e953aa045d" containerName="revoke-keys"
Oct 30 22:32:53.668330 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.668330    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b33a2b8-30b6-4b27-a76b-a6e953aa045d" containerName="revoke-keys"
Oct 30 22:32:53.668500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.668365    5575 cpu_manager.go:414] "containerMap: removing container" podUID="1b083b9f-247f-49f3-955b-37b6f41d90f3" containerName="main"
Oct 30 22:32:53.668500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.668373    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b083b9f-247f-49f3-955b-37b6f41d90f3" containerName="main"
Oct 30 22:32:53.668500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.668488    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b33a2b8-30b6-4b27-a76b-a6e953aa045d" containerName="revoke-keys"
Oct 30 22:32:53.668500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.668501    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b083b9f-247f-49f3-955b-37b6f41d90f3" containerName="main"
Oct 30 22:32:53.677613 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.677594    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.730190 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.730167    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"]
Oct 30 22:32:53.776911 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.776849    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:32:53.776911 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.776904    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z2hc6\""
Oct 30 22:32:53.810531 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.810500    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6mxc\" (UniqueName: \"kubernetes.io/projected/838fe7b2-473b-4ed9-a953-983178ecca92-kube-api-access-f6mxc\") pod \"maas-api-revoke-sub-ad2fbdee-8c76d\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.810650 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.810546    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ad2fbdee-8c76d\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.810738 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.810720    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ad2fbdee-8c76d\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.911656 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.911633    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6mxc\" (UniqueName: \"kubernetes.io/projected/838fe7b2-473b-4ed9-a953-983178ecca92-kube-api-access-f6mxc\") pod \"maas-api-revoke-sub-ad2fbdee-8c76d\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.911804 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.911660    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ad2fbdee-8c76d\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.911804 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.911722    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ad2fbdee-8c76d\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.912349 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.912327    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ad2fbdee-8c76d\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.914315 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.914285    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ad2fbdee-8c76d\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.973390 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.973364    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6mxc\" (UniqueName: \"kubernetes.io/projected/838fe7b2-473b-4ed9-a953-983178ecca92-kube-api-access-f6mxc\") pod \"maas-api-revoke-sub-ad2fbdee-8c76d\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:53.991031 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:53.991007    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:54.368248 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:54.368225    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"]
Oct 30 22:32:54.369667 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:32:54.369640    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838fe7b2_473b_4ed9_a953_983178ecca92.slice/crio-ca8b9b2c5e8df7c75e22949762785d7dc75a87bcbbedf36b62df26ec539ad0b6 WatchSource:0}: Error finding container ca8b9b2c5e8df7c75e22949762785d7dc75a87bcbbedf36b62df26ec539ad0b6: Status 404 returned error can't find the container with id ca8b9b2c5e8df7c75e22949762785d7dc75a87bcbbedf36b62df26ec539ad0b6
Oct 30 22:32:55.048207 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:55.048172    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"]
Oct 30 22:32:55.097717 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:55.097679    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-rb5mr"]
Oct 30 22:32:55.126347 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:55.126322    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea" path="/var/lib/kubelet/pods/cd65d8bd-cbe6-4b8c-9f77-1162bd7746ea/volumes"
Oct 30 22:32:55.372737 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:55.372667    5575 generic.go:356] "Generic (PLEG): container finished" podID="838fe7b2-473b-4ed9-a953-983178ecca92" containerID="dbaed017f07c1a66a835a72dfa82d1a2f204ae226d1cb171bdc9fd297bd48e25" exitCode=0
Oct 30 22:32:55.372863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:55.372746    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d" event={"ID":"838fe7b2-473b-4ed9-a953-983178ecca92","Type":"ContainerDied","Data":"dbaed017f07c1a66a835a72dfa82d1a2f204ae226d1cb171bdc9fd297bd48e25"}
Oct 30 22:32:55.372863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:55.372790    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d" event={"ID":"838fe7b2-473b-4ed9-a953-983178ecca92","Type":"ContainerStarted","Data":"ca8b9b2c5e8df7c75e22949762785d7dc75a87bcbbedf36b62df26ec539ad0b6"}
Oct 30 22:32:56.510585 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.510563    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:56.638090 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.638067    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/838fe7b2-473b-4ed9-a953-983178ecca92-kube-api-access-f6mxc\" (UniqueName: \"kubernetes.io/projected/838fe7b2-473b-4ed9-a953-983178ecca92-kube-api-access-f6mxc\") pod \"838fe7b2-473b-4ed9-a953-983178ecca92\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") "
Oct 30 22:32:56.638248 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.638107    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-xks-ca\") pod \"838fe7b2-473b-4ed9-a953-983178ecca92\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") "
Oct 30 22:32:56.638248 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.638193    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-openshift-ca\") pod \"838fe7b2-473b-4ed9-a953-983178ecca92\" (UID: \"838fe7b2-473b-4ed9-a953-983178ecca92\") "
Oct 30 22:32:56.638575 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.638553    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-openshift-ca" pod "838fe7b2-473b-4ed9-a953-983178ecca92" (UID: "838fe7b2-473b-4ed9-a953-983178ecca92"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:32:56.640354 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.640333    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/838fe7b2-473b-4ed9-a953-983178ecca92-kube-api-access-f6mxc" pod "838fe7b2-473b-4ed9-a953-983178ecca92" (UID: "838fe7b2-473b-4ed9-a953-983178ecca92"). InnerVolumeSpecName "kube-api-access-f6mxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:56.640500 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.640482    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-xks-ca" pod "838fe7b2-473b-4ed9-a953-983178ecca92" (UID: "838fe7b2-473b-4ed9-a953-983178ecca92"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:32:56.739037 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.739012    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-xks-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:56.739037 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.739034    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/838fe7b2-473b-4ed9-a953-983178ecca92-maas-api-openshift-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:56.739166 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:56.739044    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6mxc\" (UniqueName: \"kubernetes.io/projected/838fe7b2-473b-4ed9-a953-983178ecca92-kube-api-access-f6mxc\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:57.386026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:57.385932    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d" event={"ID":"838fe7b2-473b-4ed9-a953-983178ecca92","Type":"ContainerDied","Data":"ca8b9b2c5e8df7c75e22949762785d7dc75a87bcbbedf36b62df26ec539ad0b6"}
Oct 30 22:32:57.386026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:57.385951    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"
Oct 30 22:32:57.386026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:32:57.386025    5575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca8b9b2c5e8df7c75e22949762785d7dc75a87bcbbedf36b62df26ec539ad0b6"
Oct 30 22:33:05.296692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:05.296657    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:07.019336 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.019291    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"]
Oct 30 22:33:07.019872 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.019747    5575 cpu_manager.go:414] "containerMap: removing container" podUID="838fe7b2-473b-4ed9-a953-983178ecca92" containerName="revoke-keys"
Oct 30 22:33:07.019872 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.019759    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="838fe7b2-473b-4ed9-a953-983178ecca92" containerName="revoke-keys"
Oct 30 22:33:07.019872 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.019830    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="838fe7b2-473b-4ed9-a953-983178ecca92" containerName="revoke-keys"
Oct 30 22:33:07.023124 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.023103    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.125777 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.125747    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 22:33:07.126026 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.125824    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 22:33:07.126572 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.126509    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k79xr\""
Oct 30 22:33:07.130213 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.130190    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"]
Oct 30 22:33:07.132482 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.132460    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-maas-api-tls\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.132590 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.132501    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-246sg\" (UniqueName: \"kubernetes.io/projected/4ef1fb86-3bed-43ea-b82c-9614078d928e-kube-api-access-246sg\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.132590 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.132533    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef1fb86-3bed-43ea-b82c-9614078d928e-openshift-service-ca\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.132728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.132678    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-metrics-certs\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.233696 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.233666    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-maas-api-tls\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.233828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.233708    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-246sg\" (UniqueName: \"kubernetes.io/projected/4ef1fb86-3bed-43ea-b82c-9614078d928e-kube-api-access-246sg\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.233828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.233744    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef1fb86-3bed-43ea-b82c-9614078d928e-openshift-service-ca\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.233828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.233788    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-metrics-certs\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.234566 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.234480    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef1fb86-3bed-43ea-b82c-9614078d928e-openshift-service-ca\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.236422 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.236402    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-maas-api-tls\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.236492 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.236439    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-metrics-certs\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.295138 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.295090    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-246sg\" (UniqueName: \"kubernetes.io/projected/4ef1fb86-3bed-43ea-b82c-9614078d928e-kube-api-access-246sg\") pod \"maas-api-5fd68d57f5-f9njs\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") " pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.336204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.336137    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:07.720169 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.720143    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"]
Oct 30 22:33:07.721503 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:33:07.721481    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef1fb86_3bed_43ea_b82c_9614078d928e.slice/crio-991e1c10960ac44ac090daefa30af52bf524228b8afa6ad0a808fdb839b3cd26 WatchSource:0}: Error finding container 991e1c10960ac44ac090daefa30af52bf524228b8afa6ad0a808fdb839b3cd26: Status 404 returned error can't find the container with id 991e1c10960ac44ac090daefa30af52bf524228b8afa6ad0a808fdb839b3cd26
Oct 30 22:33:07.722829 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:07.722811    5575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:33:08.456829 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:08.456799    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs" event={"ID":"4ef1fb86-3bed-43ea-b82c-9614078d928e","Type":"ContainerStarted","Data":"991e1c10960ac44ac090daefa30af52bf524228b8afa6ad0a808fdb839b3cd26"}
Oct 30 22:33:09.464222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:09.464187    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs" event={"ID":"4ef1fb86-3bed-43ea-b82c-9614078d928e","Type":"ContainerStarted","Data":"3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a"}
Oct 30 22:33:09.464614 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:09.464323    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:09.623909 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:09.623854    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs" podStartSLOduration=2.803705735 podStartE2EDuration="3.623840645s" totalImagesPullingTime="820.13491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:09.622457706 +0000 UTC m=+4190.654306243" watchObservedRunningTime="2026-10-30 22:33:09.623840645 +0000 UTC m=+4190.655689179"
Oct 30 22:33:13.726735 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:13.726697    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:14.385499 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:14.385460    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:14.596820 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:14.596787    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:15.476143 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:15.476105    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:18.015546 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:18.015497    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:18.184052 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:18.184000    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:18.345974 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:18.345885    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:19.978714 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:19.978687    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:33:19.993890 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:19.993864    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:33:19.998649 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:19.998627    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:33:20.011673 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:20.011655    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:33:21.316375 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.316346    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:21.468481 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.468402    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:21.698793 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.698715    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"]
Oct 30 22:33:21.705189 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.704661    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:21.760891 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.760823    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"]
Oct 30 22:33:21.765793 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.765761    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f4fp\" (UniqueName: \"kubernetes.io/projected/e365d359-3962-4aaa-bfd3-9dc01a99fa00-kube-api-access-2f4fp\") pod \"payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc\" (UID: \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:21.765922 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.765824    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e365d359-3962-4aaa-bfd3-9dc01a99fa00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc\" (UID: \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:21.806848 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.806814    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9871e8fb-dockercfg-gx4p6\""
Oct 30 22:33:21.807090 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.807012    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9871e8fb\""
Oct 30 22:33:21.840695 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.840663    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"]
Oct 30 22:33:21.844423 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.844408    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:21.866641 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.866612    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f4fp\" (UniqueName: \"kubernetes.io/projected/e365d359-3962-4aaa-bfd3-9dc01a99fa00-kube-api-access-2f4fp\") pod \"payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc\" (UID: \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:21.866768 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.866667    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e365d359-3962-4aaa-bfd3-9dc01a99fa00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc\" (UID: \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:21.867528 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.867506    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e365d359-3962-4aaa-bfd3-9dc01a99fa00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc\" (UID: \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:21.904243 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.904214    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"]
Oct 30 22:33:21.931675 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.931640    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f4fp\" (UniqueName: \"kubernetes.io/projected/e365d359-3962-4aaa-bfd3-9dc01a99fa00-kube-api-access-2f4fp\") pod \"payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc\" (UID: \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:21.967988 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.967935    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzwj8\" (UniqueName: \"kubernetes.io/projected/5d93ce8c-e5ff-468d-b655-f94d313fed86-kube-api-access-vzwj8\") pod \"payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw\" (UID: \"5d93ce8c-e5ff-468d-b655-f94d313fed86\") " pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:21.968130 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:21.968012    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d93ce8c-e5ff-468d-b655-f94d313fed86-plugins-config-volume\") pod \"payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw\" (UID: \"5d93ce8c-e5ff-468d-b655-f94d313fed86\") " pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:22.018843 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.018779    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:22.069298 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.069265    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzwj8\" (UniqueName: \"kubernetes.io/projected/5d93ce8c-e5ff-468d-b655-f94d313fed86-kube-api-access-vzwj8\") pod \"payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw\" (UID: \"5d93ce8c-e5ff-468d-b655-f94d313fed86\") " pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:22.069458 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.069335    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d93ce8c-e5ff-468d-b655-f94d313fed86-plugins-config-volume\") pod \"payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw\" (UID: \"5d93ce8c-e5ff-468d-b655-f94d313fed86\") " pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:22.070504 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.070467    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d93ce8c-e5ff-468d-b655-f94d313fed86-plugins-config-volume\") pod \"payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw\" (UID: \"5d93ce8c-e5ff-468d-b655-f94d313fed86\") " pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:22.099339 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.099002    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"]
Oct 30 22:33:22.103987 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.103951    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.130635 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.130595    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzwj8\" (UniqueName: \"kubernetes.io/projected/5d93ce8c-e5ff-468d-b655-f94d313fed86-kube-api-access-vzwj8\") pod \"payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw\" (UID: \"5d93ce8c-e5ff-468d-b655-f94d313fed86\") " pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:22.156706 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.156646    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9871e8fb-serving-cert\""
Oct 30 22:33:22.158977 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.158933    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:22.160767 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.160731    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"]
Oct 30 22:33:22.170777 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.170737    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad410b-3b01-4ec7-957f-0ed52944a06f-openshift-service-ca\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.170899 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.170848    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-metrics-certs\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.171024 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.170999    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s78h\" (UniqueName: \"kubernetes.io/projected/b6ad410b-3b01-4ec7-957f-0ed52944a06f-kube-api-access-2s78h\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.171090 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.171040    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.273585 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.271747    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad410b-3b01-4ec7-957f-0ed52944a06f-openshift-service-ca\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.273585 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.271861    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-metrics-certs\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.273585 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.271911    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s78h\" (UniqueName: \"kubernetes.io/projected/b6ad410b-3b01-4ec7-957f-0ed52944a06f-kube-api-access-2s78h\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.273585 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.271937    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.273585 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:33:22.272173    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-serving-cert: secret "maas-api-e2e-ait-9871e8fb-serving-cert" not found
Oct 30 22:33:22.273585 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:33:22.272244    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls podName:b6ad410b-3b01-4ec7-957f-0ed52944a06f nodeName:}" failed. No retries permitted until 2026-10-30 22:33:22.772220482 +0000 UTC m=+4203.804069014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls") pod "maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb" (UID: "b6ad410b-3b01-4ec7-957f-0ed52944a06f") : secret "maas-api-e2e-ait-9871e8fb-serving-cert" not found
Oct 30 22:33:22.273585 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.272939    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad410b-3b01-4ec7-957f-0ed52944a06f-openshift-service-ca\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.281776 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.281338    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-metrics-certs\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.334870 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.334840    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s78h\" (UniqueName: \"kubernetes.io/projected/b6ad410b-3b01-4ec7-957f-0ed52944a06f-kube-api-access-2s78h\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.349351 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.349319    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:22.406119 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.405909    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"]
Oct 30 22:33:22.413796 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:33:22.413768    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode365d359_3962_4aaa_bfd3_9dc01a99fa00.slice/crio-e8b3112b43d73733109a81247ed80c577477de8083858924b8bbce73d17dc446 WatchSource:0}: Error finding container e8b3112b43d73733109a81247ed80c577477de8083858924b8bbce73d17dc446: Status 404 returned error can't find the container with id e8b3112b43d73733109a81247ed80c577477de8083858924b8bbce73d17dc446
Oct 30 22:33:22.506265 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.506236    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:22.537633 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:33:22.537606    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d93ce8c_e5ff_468d_b655_f94d313fed86.slice/crio-26a84150c5229815388c8220e86062e8c97c31f39a131aac3d482ef7fdc821ba WatchSource:0}: Error finding container 26a84150c5229815388c8220e86062e8c97c31f39a131aac3d482ef7fdc821ba: Status 404 returned error can't find the container with id 26a84150c5229815388c8220e86062e8c97c31f39a131aac3d482ef7fdc821ba
Oct 30 22:33:22.537983 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.537942    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"]
Oct 30 22:33:22.558555 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.558497    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc" event={"ID":"e365d359-3962-4aaa-bfd3-9dc01a99fa00","Type":"ContainerStarted","Data":"6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72"}
Oct 30 22:33:22.558755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.558586    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc" event={"ID":"e365d359-3962-4aaa-bfd3-9dc01a99fa00","Type":"ContainerStarted","Data":"e8b3112b43d73733109a81247ed80c577477de8083858924b8bbce73d17dc446"}
Oct 30 22:33:22.558755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.558616    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:22.560329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.560297    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw" event={"ID":"5d93ce8c-e5ff-468d-b655-f94d313fed86","Type":"ContainerStarted","Data":"26a84150c5229815388c8220e86062e8c97c31f39a131aac3d482ef7fdc821ba"}
Oct 30 22:33:22.659462 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.659435    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:22.675831 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.675789    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc" podStartSLOduration=1.675776492 podStartE2EDuration="1.675776492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:22.674059882 +0000 UTC m=+4203.705908418" watchObservedRunningTime="2026-10-30 22:33:22.675776492 +0000 UTC m=+4203.707625072"
Oct 30 22:33:22.778320 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.778297    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:22.780786 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:22.780764    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls\") pod \"maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:23.021244 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:23.021215    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:23.447820 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:23.447791    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"]
Oct 30 22:33:23.448611 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:33:23.448581    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ad410b_3b01_4ec7_957f_0ed52944a06f.slice/crio-4b11d6571f188abfc61699978d987dc8e657d23a2d1825fdc50f75b6889293f2 WatchSource:0}: Error finding container 4b11d6571f188abfc61699978d987dc8e657d23a2d1825fdc50f75b6889293f2: Status 404 returned error can't find the container with id 4b11d6571f188abfc61699978d987dc8e657d23a2d1825fdc50f75b6889293f2
Oct 30 22:33:23.485431 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:33:23.485405    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:33:23.569530 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:23.569494    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw" event={"ID":"5d93ce8c-e5ff-468d-b655-f94d313fed86","Type":"ContainerStarted","Data":"875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da"}
Oct 30 22:33:23.569671 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:23.569587    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:23.571082 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:23.571051    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb" event={"ID":"b6ad410b-3b01-4ec7-957f-0ed52944a06f","Type":"ContainerStarted","Data":"4b11d6571f188abfc61699978d987dc8e657d23a2d1825fdc50f75b6889293f2"}
Oct 30 22:33:23.693572 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:23.693495    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw" podStartSLOduration=2.693481557 podStartE2EDuration="2.693481557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:23.689116017 +0000 UTC m=+4204.720964551" watchObservedRunningTime="2026-10-30 22:33:23.693481557 +0000 UTC m=+4204.725330093"
Oct 30 22:33:24.578877 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:24.578782    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb" event={"ID":"b6ad410b-3b01-4ec7-957f-0ed52944a06f","Type":"ContainerStarted","Data":"7b032c00b21ffe451eb3bdfb384802ed006c102bc3030e8011181a36c14fef72"}
Oct 30 22:33:24.579369 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:24.578945    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:24.698163 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:24.698119    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb" podStartSLOduration=1.898041861 podStartE2EDuration="2.698105074s" totalImagesPullingTime="800.063213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:24.696065712 +0000 UTC m=+4205.727914246" watchObservedRunningTime="2026-10-30 22:33:24.698105074 +0000 UTC m=+4205.729953608"
Oct 30 22:33:25.968306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:25.968270    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"]
Oct 30 22:33:25.972791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:25.972767    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.077908 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.077879    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"]
Oct 30 22:33:26.114579 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.114545    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-openshift-service-ca\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.114742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.114603    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbl52\" (UniqueName: \"kubernetes.io/projected/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-kube-api-access-xbl52\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.114742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.114729    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-metrics-certs\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.114817 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.114760    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-maas-api-tls\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.215434 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.215402    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-metrics-certs\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.215434 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.215436    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-maas-api-tls\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.215701 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.215495    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-openshift-service-ca\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.215701 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.215532    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbl52\" (UniqueName: \"kubernetes.io/projected/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-kube-api-access-xbl52\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.216293 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.216268    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-openshift-service-ca\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.218201 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.218173    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-metrics-certs\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.218337 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.218231    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-maas-api-tls\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.276872 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.276837    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbl52\" (UniqueName: \"kubernetes.io/projected/95cf6cf0-4dfc-4389-89f0-f5b0d8955456-kube-api-access-xbl52\") pod \"maas-api-5bb5fc9b7-8n6fc\" (UID: \"95cf6cf0-4dfc-4389-89f0-f5b0d8955456\") " pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.287135 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.287111    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:26.669105 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:26.669069    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"]
Oct 30 22:33:26.670318 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:33:26.670296    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cf6cf0_4dfc_4389_89f0_f5b0d8955456.slice/crio-809a702d48da0b81319c01746e96736afd5bc8a4bd307991bec54cd2f2db64fe WatchSource:0}: Error finding container 809a702d48da0b81319c01746e96736afd5bc8a4bd307991bec54cd2f2db64fe: Status 404 returned error can't find the container with id 809a702d48da0b81319c01746e96736afd5bc8a4bd307991bec54cd2f2db64fe
Oct 30 22:33:27.599665 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:27.599636    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc" event={"ID":"95cf6cf0-4dfc-4389-89f0-f5b0d8955456","Type":"ContainerStarted","Data":"809a702d48da0b81319c01746e96736afd5bc8a4bd307991bec54cd2f2db64fe"}
Oct 30 22:33:27.774266 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:27.774230    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:28.608492 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:28.608453    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc" event={"ID":"95cf6cf0-4dfc-4389-89f0-f5b0d8955456","Type":"ContainerStarted","Data":"6cdd2347b1c3b5844e893a807016eef991b2f7781d85d80aacbfe7ca2cf54b65"}
Oct 30 22:33:28.608913 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:28.608583    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:28.732294 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:28.732243    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc" podStartSLOduration=2.830581926 podStartE2EDuration="3.732230191s" totalImagesPullingTime="901.648265ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:28.731276687 +0000 UTC m=+4209.763125221" watchObservedRunningTime="2026-10-30 22:33:28.732230191 +0000 UTC m=+4209.764078725"
Oct 30 22:33:30.591786 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:30.591753    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:33:32.846176 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:32.846141    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:33.574659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:33.574632    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:33:34.582789 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:34.582756    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:33:34.621855 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:34.621830    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5bb5fc9b7-8n6fc"
Oct 30 22:33:34.852207 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:34.852123    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"]
Oct 30 22:33:34.852441 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:34.852415    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs" podUID="4ef1fb86-3bed-43ea-b82c-9614078d928e" containerName="maas-api" containerID="cri-o://3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a" gracePeriod=30
Oct 30 22:33:35.115441 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.115371    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:35.118656 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.118636    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ef1fb86-3bed-43ea-b82c-9614078d928e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef1fb86-3bed-43ea-b82c-9614078d928e-openshift-service-ca\") pod \"4ef1fb86-3bed-43ea-b82c-9614078d928e\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") "
Oct 30 22:33:35.118723 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.118707    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ef1fb86-3bed-43ea-b82c-9614078d928e-kube-api-access-246sg\" (UniqueName: \"kubernetes.io/projected/4ef1fb86-3bed-43ea-b82c-9614078d928e-kube-api-access-246sg\") pod \"4ef1fb86-3bed-43ea-b82c-9614078d928e\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") "
Oct 30 22:33:35.118833 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.118816    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-metrics-certs\") pod \"4ef1fb86-3bed-43ea-b82c-9614078d928e\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") "
Oct 30 22:33:35.119068 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.119045    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef1fb86-3bed-43ea-b82c-9614078d928e-openshift-service-ca" pod "4ef1fb86-3bed-43ea-b82c-9614078d928e" (UID: "4ef1fb86-3bed-43ea-b82c-9614078d928e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:33:35.119251 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.119233    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef1fb86-3bed-43ea-b82c-9614078d928e-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:35.120952 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.120919    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef1fb86-3bed-43ea-b82c-9614078d928e-kube-api-access-246sg" pod "4ef1fb86-3bed-43ea-b82c-9614078d928e" (UID: "4ef1fb86-3bed-43ea-b82c-9614078d928e"). InnerVolumeSpecName "kube-api-access-246sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:33:35.121068 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.121000    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-metrics-certs" pod "4ef1fb86-3bed-43ea-b82c-9614078d928e" (UID: "4ef1fb86-3bed-43ea-b82c-9614078d928e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:33:35.219913 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.219884    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-maas-api-tls\") pod \"4ef1fb86-3bed-43ea-b82c-9614078d928e\" (UID: \"4ef1fb86-3bed-43ea-b82c-9614078d928e\") "
Oct 30 22:33:35.220305 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.220280    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-246sg\" (UniqueName: \"kubernetes.io/projected/4ef1fb86-3bed-43ea-b82c-9614078d928e-kube-api-access-246sg\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:35.220305 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.220302    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:35.222121 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.222098    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-maas-api-tls" pod "4ef1fb86-3bed-43ea-b82c-9614078d928e" (UID: "4ef1fb86-3bed-43ea-b82c-9614078d928e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:33:35.320961 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.320928    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ef1fb86-3bed-43ea-b82c-9614078d928e-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:35.655611 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.655580    5575 generic.go:356] "Generic (PLEG): container finished" podID="4ef1fb86-3bed-43ea-b82c-9614078d928e" containerID="3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a" exitCode=0
Oct 30 22:33:35.656152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.655628    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"
Oct 30 22:33:35.656152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.655640    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs" event={"ID":"4ef1fb86-3bed-43ea-b82c-9614078d928e","Type":"ContainerDied","Data":"3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a"}
Oct 30 22:33:35.656152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.655683    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs" event={"ID":"4ef1fb86-3bed-43ea-b82c-9614078d928e","Type":"ContainerDied","Data":"991e1c10960ac44ac090daefa30af52bf524228b8afa6ad0a808fdb839b3cd26"}
Oct 30 22:33:35.656152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.655704    5575 scope.go:122] "RemoveContainer" containerID="3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a"
Oct 30 22:33:35.666801 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.666778    5575 scope.go:122] "RemoveContainer" containerID="3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a"
Oct 30 22:33:35.667159 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:33:35.667136    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a\": container with ID starting with 3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a not found: ID does not exist" containerID="3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a"
Oct 30 22:33:35.667240 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.667168    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a"} err="failed to get container status \"3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a\": rpc error: code = NotFound desc = could not find container \"3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a\": container with ID starting with 3ba90806f7773ee0eec030134a4dff247c4e72fe1a802e7635c4acde5c8b004a not found: ID does not exist"
Oct 30 22:33:35.822272 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.822240    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"]
Oct 30 22:33:35.826562 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:35.826538    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fd68d57f5-f9njs"]
Oct 30 22:33:37.126093 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:37.126062    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4ef1fb86-3bed-43ea-b82c-9614078d928e" path="/var/lib/kubelet/pods/4ef1fb86-3bed-43ea-b82c-9614078d928e/volumes"
Oct 30 22:33:38.210796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:38.210761    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:43.393720 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:43.393682    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:48.629732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:48.629685    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:53.485150 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:33:53.485115    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:33:53.674538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:53.674502    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:56.041333 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:56.041295    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"]
Oct 30 22:33:56.149995 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:56.149952    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"]
Oct 30 22:33:56.425937 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:56.425906    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:56.591185 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:56.591144    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:58.516090 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:33:58.516058    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:01.041791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.041703    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw" podUID="5d93ce8c-e5ff-468d-b655-f94d313fed86" containerName="payload-processing" containerID="cri-o://875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da" gracePeriod=25
Oct 30 22:34:01.150479 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.150448    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc" podUID="e365d359-3962-4aaa-bfd3-9dc01a99fa00" containerName="payload-pre-processing" containerID="cri-o://6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72" gracePeriod=25
Oct 30 22:34:01.288879 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.288853    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:34:01.367180 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.367149    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5d93ce8c-e5ff-468d-b655-f94d313fed86-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d93ce8c-e5ff-468d-b655-f94d313fed86-plugins-config-volume\") pod \"5d93ce8c-e5ff-468d-b655-f94d313fed86\" (UID: \"5d93ce8c-e5ff-468d-b655-f94d313fed86\") "
Oct 30 22:34:01.367361 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.367238    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d93ce8c-e5ff-468d-b655-f94d313fed86-kube-api-access-vzwj8\" (UniqueName: \"kubernetes.io/projected/5d93ce8c-e5ff-468d-b655-f94d313fed86-kube-api-access-vzwj8\") pod \"5d93ce8c-e5ff-468d-b655-f94d313fed86\" (UID: \"5d93ce8c-e5ff-468d-b655-f94d313fed86\") "
Oct 30 22:34:01.367601 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.367572    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d93ce8c-e5ff-468d-b655-f94d313fed86-plugins-config-volume" pod "5d93ce8c-e5ff-468d-b655-f94d313fed86" (UID: "5d93ce8c-e5ff-468d-b655-f94d313fed86"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:34:01.369590 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.369565    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d93ce8c-e5ff-468d-b655-f94d313fed86-kube-api-access-vzwj8" pod "5d93ce8c-e5ff-468d-b655-f94d313fed86" (UID: "5d93ce8c-e5ff-468d-b655-f94d313fed86"). InnerVolumeSpecName "kube-api-access-vzwj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:01.404438 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.404411    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:34:01.468555 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.468530    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e365d359-3962-4aaa-bfd3-9dc01a99fa00-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e365d359-3962-4aaa-bfd3-9dc01a99fa00-plugins-config-volume\") pod \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\" (UID: \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\") "
Oct 30 22:34:01.468695 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.468595    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e365d359-3962-4aaa-bfd3-9dc01a99fa00-kube-api-access-2f4fp\" (UniqueName: \"kubernetes.io/projected/e365d359-3962-4aaa-bfd3-9dc01a99fa00-kube-api-access-2f4fp\") pod \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\" (UID: \"e365d359-3962-4aaa-bfd3-9dc01a99fa00\") "
Oct 30 22:34:01.468961 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.468931    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e365d359-3962-4aaa-bfd3-9dc01a99fa00-plugins-config-volume" pod "e365d359-3962-4aaa-bfd3-9dc01a99fa00" (UID: "e365d359-3962-4aaa-bfd3-9dc01a99fa00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:34:01.468961 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.468934    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzwj8\" (UniqueName: \"kubernetes.io/projected/5d93ce8c-e5ff-468d-b655-f94d313fed86-kube-api-access-vzwj8\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:01.469150 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.469004    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d93ce8c-e5ff-468d-b655-f94d313fed86-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:01.470711 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.470686    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e365d359-3962-4aaa-bfd3-9dc01a99fa00-kube-api-access-2f4fp" pod "e365d359-3962-4aaa-bfd3-9dc01a99fa00" (UID: "e365d359-3962-4aaa-bfd3-9dc01a99fa00"). InnerVolumeSpecName "kube-api-access-2f4fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:01.569868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.569833    5575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e365d359-3962-4aaa-bfd3-9dc01a99fa00-plugins-config-volume\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:01.569868 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.569863    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f4fp\" (UniqueName: \"kubernetes.io/projected/e365d359-3962-4aaa-bfd3-9dc01a99fa00-kube-api-access-2f4fp\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:01.813598 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.813566    5575 generic.go:356] "Generic (PLEG): container finished" podID="e365d359-3962-4aaa-bfd3-9dc01a99fa00" containerID="6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72" exitCode=0
Oct 30 22:34:01.813739 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.813621    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"
Oct 30 22:34:01.813739 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.813644    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc" event={"ID":"e365d359-3962-4aaa-bfd3-9dc01a99fa00","Type":"ContainerDied","Data":"6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72"}
Oct 30 22:34:01.813739 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.813718    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc" event={"ID":"e365d359-3962-4aaa-bfd3-9dc01a99fa00","Type":"ContainerDied","Data":"e8b3112b43d73733109a81247ed80c577477de8083858924b8bbce73d17dc446"}
Oct 30 22:34:01.813739 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.813739    5575 scope.go:122] "RemoveContainer" containerID="6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72"
Oct 30 22:34:01.815309 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.815242    5575 generic.go:356] "Generic (PLEG): container finished" podID="5d93ce8c-e5ff-468d-b655-f94d313fed86" containerID="875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da" exitCode=0
Oct 30 22:34:01.815309 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.815293    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"
Oct 30 22:34:01.815309 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.815306    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw" event={"ID":"5d93ce8c-e5ff-468d-b655-f94d313fed86","Type":"ContainerDied","Data":"875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da"}
Oct 30 22:34:01.815309 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.815335    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw" event={"ID":"5d93ce8c-e5ff-468d-b655-f94d313fed86","Type":"ContainerDied","Data":"26a84150c5229815388c8220e86062e8c97c31f39a131aac3d482ef7fdc821ba"}
Oct 30 22:34:01.825703 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.825683    5575 scope.go:122] "RemoveContainer" containerID="6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72"
Oct 30 22:34:01.825952 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:34:01.825932    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72\": container with ID starting with 6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72 not found: ID does not exist" containerID="6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72"
Oct 30 22:34:01.826063 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.825992    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72"} err="failed to get container status \"6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72\": rpc error: code = NotFound desc = could not find container \"6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72\": container with ID starting with 6b1bdee4845edb9e074b9ce2ce8d49ef3621f9c914898b8c4f28e17ecead5f72 not found: ID does not exist"
Oct 30 22:34:01.826063 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.826019    5575 scope.go:122] "RemoveContainer" containerID="875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da"
Oct 30 22:34:01.834893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.834879    5575 scope.go:122] "RemoveContainer" containerID="875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da"
Oct 30 22:34:01.835140 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:34:01.835123    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da\": container with ID starting with 875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da not found: ID does not exist" containerID="875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da"
Oct 30 22:34:01.835215 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.835146    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da"} err="failed to get container status \"875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da\": rpc error: code = NotFound desc = could not find container \"875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da\": container with ID starting with 875629cd4abec009bc7d5300addf03446f025b18da934dee2ee11cbadde172da not found: ID does not exist"
Oct 30 22:34:01.978470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:01.978441    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"]
Oct 30 22:34:02.028459 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:02.028430    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9871e8fb-79fc57975f-z7xnc"]
Oct 30 22:34:02.137288 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:02.137264    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"]
Oct 30 22:34:02.143940 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:02.143916    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9871e8fb-594cfc8498-hgfkw"]
Oct 30 22:34:02.689681 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:02.689650    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"]
Oct 30 22:34:02.689893 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:02.689871    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb" podUID="b6ad410b-3b01-4ec7-957f-0ed52944a06f" containerName="maas-api" containerID="cri-o://7b032c00b21ffe451eb3bdfb384802ed006c102bc3030e8011181a36c14fef72" gracePeriod=30
Oct 30 22:34:02.828807 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:02.828771    5575 generic.go:356] "Generic (PLEG): container finished" podID="b6ad410b-3b01-4ec7-957f-0ed52944a06f" containerID="7b032c00b21ffe451eb3bdfb384802ed006c102bc3030e8011181a36c14fef72" exitCode=0
Oct 30 22:34:02.829015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:02.828848    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb" event={"ID":"b6ad410b-3b01-4ec7-957f-0ed52944a06f","Type":"ContainerDied","Data":"7b032c00b21ffe451eb3bdfb384802ed006c102bc3030e8011181a36c14fef72"}
Oct 30 22:34:02.854343 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:02.854309    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:02.955689 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:02.955635    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:34:03.091411 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.091363    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls\") pod \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") "
Oct 30 22:34:03.091597 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.091435    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6ad410b-3b01-4ec7-957f-0ed52944a06f-kube-api-access-2s78h\" (UniqueName: \"kubernetes.io/projected/b6ad410b-3b01-4ec7-957f-0ed52944a06f-kube-api-access-2s78h\") pod \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") "
Oct 30 22:34:03.091658 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.091614    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b6ad410b-3b01-4ec7-957f-0ed52944a06f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad410b-3b01-4ec7-957f-0ed52944a06f-openshift-service-ca\") pod \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") "
Oct 30 22:34:03.091763 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.091686    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-metrics-certs\") pod \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\" (UID: \"b6ad410b-3b01-4ec7-957f-0ed52944a06f\") "
Oct 30 22:34:03.093685 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.093654    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ad410b-3b01-4ec7-957f-0ed52944a06f-openshift-service-ca" pod "b6ad410b-3b01-4ec7-957f-0ed52944a06f" (UID: "b6ad410b-3b01-4ec7-957f-0ed52944a06f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:34:03.095526 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.095009    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-metrics-certs" pod "b6ad410b-3b01-4ec7-957f-0ed52944a06f" (UID: "b6ad410b-3b01-4ec7-957f-0ed52944a06f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:03.095526 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.095394    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6ad410b-3b01-4ec7-957f-0ed52944a06f-kube-api-access-2s78h" pod "b6ad410b-3b01-4ec7-957f-0ed52944a06f" (UID: "b6ad410b-3b01-4ec7-957f-0ed52944a06f"). InnerVolumeSpecName "kube-api-access-2s78h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:03.095901 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.095882    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls" pod "b6ad410b-3b01-4ec7-957f-0ed52944a06f" (UID: "b6ad410b-3b01-4ec7-957f-0ed52944a06f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:03.126519 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.126488    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5d93ce8c-e5ff-468d-b655-f94d313fed86" path="/var/lib/kubelet/pods/5d93ce8c-e5ff-468d-b655-f94d313fed86/volumes"
Oct 30 22:34:03.126871 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.126859    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e365d359-3962-4aaa-bfd3-9dc01a99fa00" path="/var/lib/kubelet/pods/e365d359-3962-4aaa-bfd3-9dc01a99fa00/volumes"
Oct 30 22:34:03.194302 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.194257    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:03.194302 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.194297    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad410b-3b01-4ec7-957f-0ed52944a06f-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:03.195863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.194313    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s78h\" (UniqueName: \"kubernetes.io/projected/b6ad410b-3b01-4ec7-957f-0ed52944a06f-kube-api-access-2s78h\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:03.195863 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.194329    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad410b-3b01-4ec7-957f-0ed52944a06f-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:03.837066 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.837031    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"
Oct 30 22:34:03.837225 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.837071    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb" event={"ID":"b6ad410b-3b01-4ec7-957f-0ed52944a06f","Type":"ContainerDied","Data":"4b11d6571f188abfc61699978d987dc8e657d23a2d1825fdc50f75b6889293f2"}
Oct 30 22:34:03.837225 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:03.837132    5575 scope.go:122] "RemoveContainer" containerID="7b032c00b21ffe451eb3bdfb384802ed006c102bc3030e8011181a36c14fef72"
Oct 30 22:34:04.003305 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:04.003271    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"]
Oct 30 22:34:04.053186 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:04.053156    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9871e8fb-6965fd468f-pmnwb"]
Oct 30 22:34:04.340796 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:04.340755    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:04.644559 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:04.644528    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:05.125816 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:05.125746    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6ad410b-3b01-4ec7-957f-0ed52944a06f" path="/var/lib/kubelet/pods/b6ad410b-3b01-4ec7-957f-0ed52944a06f/volumes"
Oct 30 22:34:05.639659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:05.639630    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:05.802872 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:05.802819    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:06.980461 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:06.980424    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:10.390107 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:10.390074    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:10.543102 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:10.543072    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:17.658952 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:17.658919    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:17.830942 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:17.830912    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:21.196895 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:21.196864    5575 scope.go:122] "RemoveContainer" containerID="fc572550ffbbd0126117a67756a5afe945c90334dc155d8d857e976c781c93b4"
Oct 30 22:34:21.206721 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:21.206690    5575 scope.go:122] "RemoveContainer" containerID="884f39d5b7f7ebf21426c04a205500890be4ceff56417383be4d074c4e762ca9"
Oct 30 22:34:22.147220 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:22.147183    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:22.343183 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:22.343141    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:22.572533 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:22.572450    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:23.486547 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:34:23.486512    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:34:25.445389 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:25.445352    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:25.605156 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:25.605124    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:28.383027 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.382996    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"]
Oct 30 22:34:28.383516 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383499    5575 cpu_manager.go:414] "containerMap: removing container" podUID="e365d359-3962-4aaa-bfd3-9dc01a99fa00" containerName="payload-pre-processing"
Oct 30 22:34:28.383584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383518    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e365d359-3962-4aaa-bfd3-9dc01a99fa00" containerName="payload-pre-processing"
Oct 30 22:34:28.383584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383543    5575 cpu_manager.go:414] "containerMap: removing container" podUID="4ef1fb86-3bed-43ea-b82c-9614078d928e" containerName="maas-api"
Oct 30 22:34:28.383584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383548    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ef1fb86-3bed-43ea-b82c-9614078d928e" containerName="maas-api"
Oct 30 22:34:28.383584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383569    5575 cpu_manager.go:414] "containerMap: removing container" podUID="b6ad410b-3b01-4ec7-957f-0ed52944a06f" containerName="maas-api"
Oct 30 22:34:28.383584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383573    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6ad410b-3b01-4ec7-957f-0ed52944a06f" containerName="maas-api"
Oct 30 22:34:28.383584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383582    5575 cpu_manager.go:414] "containerMap: removing container" podUID="5d93ce8c-e5ff-468d-b655-f94d313fed86" containerName="payload-processing"
Oct 30 22:34:28.383773 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383588    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d93ce8c-e5ff-468d-b655-f94d313fed86" containerName="payload-processing"
Oct 30 22:34:28.383773 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383660    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6ad410b-3b01-4ec7-957f-0ed52944a06f" containerName="maas-api"
Oct 30 22:34:28.383773 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383670    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d93ce8c-e5ff-468d-b655-f94d313fed86" containerName="payload-processing"
Oct 30 22:34:28.383773 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383678    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="e365d359-3962-4aaa-bfd3-9dc01a99fa00" containerName="payload-pre-processing"
Oct 30 22:34:28.383773 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.383686    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ef1fb86-3bed-43ea-b82c-9614078d928e" containerName="maas-api"
Oct 30 22:34:28.386922 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.386904    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.439476 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.439449    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-563990-serving-cert\""
Oct 30 22:34:28.450502 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.450475    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.450627 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.450520    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-metrics-certs\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.450738 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.450710    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/643040e9-8a0a-41c6-b231-e6445fac9845-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.450851 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.450830    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5fqd\" (UniqueName: \"kubernetes.io/projected/643040e9-8a0a-41c6-b231-e6445fac9845-kube-api-access-s5fqd\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.492114 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.492087    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"]
Oct 30 22:34:28.551538 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.551507    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5fqd\" (UniqueName: \"kubernetes.io/projected/643040e9-8a0a-41c6-b231-e6445fac9845-kube-api-access-s5fqd\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.551678 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.551560    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.551678 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.551595    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-metrics-certs\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.551763 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.551701    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/643040e9-8a0a-41c6-b231-e6445fac9845-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.551763 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:34:28.551719    5575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-serving-cert: secret "maas-api-e2e-authcfg-http-563990-serving-cert" not found
Oct 30 22:34:28.551845 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:34:28.551773    5575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls podName:643040e9-8a0a-41c6-b231-e6445fac9845 nodeName:}" failed. No retries permitted until 2026-10-30 22:34:29.051758876 +0000 UTC m=+4270.083607389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls") pod "maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4" (UID: "643040e9-8a0a-41c6-b231-e6445fac9845") : secret "maas-api-e2e-authcfg-http-563990-serving-cert" not found
Oct 30 22:34:28.552362 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.552338    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/643040e9-8a0a-41c6-b231-e6445fac9845-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.554178 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.554159    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-metrics-certs\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.596323 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.596272    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:28.615019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.614991    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5fqd\" (UniqueName: \"kubernetes.io/projected/643040e9-8a0a-41c6-b231-e6445fac9845-kube-api-access-s5fqd\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:28.755997 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.755903    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:28.933097 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:28.933063    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:29.056896 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:29.056819    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:29.059357 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:29.059336    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:29.299842 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:29.299814    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:29.680102 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:29.680079    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"]
Oct 30 22:34:29.682419 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:34:29.682391    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643040e9_8a0a_41c6_b231_e6445fac9845.slice/crio-1bc604046a100e3a0ccad0cc43a8813d1e092e12ef413ea6d1f47a9de5ae3dad WatchSource:0}: Error finding container 1bc604046a100e3a0ccad0cc43a8813d1e092e12ef413ea6d1f47a9de5ae3dad: Status 404 returned error can't find the container with id 1bc604046a100e3a0ccad0cc43a8813d1e092e12ef413ea6d1f47a9de5ae3dad
Oct 30 22:34:30.004310 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:30.004235    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4" event={"ID":"643040e9-8a0a-41c6-b231-e6445fac9845","Type":"ContainerStarted","Data":"1bc604046a100e3a0ccad0cc43a8813d1e092e12ef413ea6d1f47a9de5ae3dad"}
Oct 30 22:34:31.012361 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:31.012326    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4" event={"ID":"643040e9-8a0a-41c6-b231-e6445fac9845","Type":"ContainerStarted","Data":"9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7"}
Oct 30 22:34:31.012792 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:31.012454    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:31.130128 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:31.130073    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4" podStartSLOduration=2.224181701 podStartE2EDuration="3.130059394s" totalImagesPullingTime="905.877693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:34:31.129456933 +0000 UTC m=+4272.161305470" watchObservedRunningTime="2026-10-30 22:34:31.130059394 +0000 UTC m=+4272.161907932"
Oct 30 22:34:33.563005 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:33.562948    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:37.024306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:37.024272    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:34:38.708797 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:38.708760    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:39.527610 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:39.527577    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:39.685400 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:39.685370    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:43.689052 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:43.689016    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:46.054104 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:46.054076    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"]
Oct 30 22:34:46.078230 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:46.078204    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8837b66a-8trvd"]
Oct 30 22:34:47.073348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:47.073321    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:47.125352 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:47.125321    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2de6c876-4fe2-4248-b737-62bcc2242652" path="/var/lib/kubelet/pods/2de6c876-4fe2-4248-b737-62bcc2242652/volumes"
Oct 30 22:34:48.992940 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:48.992902    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:53.487378 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:34:53.487338    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:34:53.897933 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:53.897901    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:58.781744 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:34:58.781714    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:03.675660 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:03.675624    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:05.986187 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:05.986156    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:08.583422 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:08.583379    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:13.681619 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:13.681587    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:18.544818 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:18.544779    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:21.129323 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:21.129285    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:23.356698 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:23.356665    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:23.485223 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:35:23.485187    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:35:28.269464 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:28.269429    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:33.102426 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:33.102325    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:37.998742 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:37.998701    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:42.858888 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:42.858842    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:43.020376 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:43.020347    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:45.899881 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:45.899851    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:46.724410 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:46.724377    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:47.758459 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:47.758413    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:52.587396 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:52.587360    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:53.485920 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:35:53.485885    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:35:57.458466 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:35:57.458432    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:02.282792 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:02.282757    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:06.331029 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:06.330998    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:07.274902 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:07.274868    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:12.158243 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:12.158207    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:17.068228 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:17.068194    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:21.261358 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:21.261325    5575 scope.go:122] "RemoveContainer" containerID="c9d1051a4c277034e00f22e3c35916c75d41d60c3fe45a423277181d35c68523"
Oct 30 22:36:21.270845 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:21.270824    5575 scope.go:122] "RemoveContainer" containerID="7a6f43f0a8ffadb5cbd590c5b52277a20450ac72b6f9b14c3e0c4096b6dfca8e"
Oct 30 22:36:22.262934 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:22.262875    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:23.488604 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:36:23.488563    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:36:27.259383 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:27.259332    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:29.949736 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:29.949696    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:30.119184 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:30.119142    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:30.431336 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:30.431304    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:32.070325 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:32.070294    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:41.318198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.318162    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"]
Oct 30 22:36:41.318682 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.318367    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4" podUID="643040e9-8a0a-41c6-b231-e6445fac9845" containerName="maas-api" containerID="cri-o://9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7" gracePeriod=30
Oct 30 22:36:41.430211 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.430186    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:41.585393 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.585366    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:36:41.642218 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.642193    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls\") pod \"643040e9-8a0a-41c6-b231-e6445fac9845\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") "
Oct 30 22:36:41.642386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.642235    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/643040e9-8a0a-41c6-b231-e6445fac9845-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/643040e9-8a0a-41c6-b231-e6445fac9845-openshift-service-ca\") pod \"643040e9-8a0a-41c6-b231-e6445fac9845\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") "
Oct 30 22:36:41.642386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.642348    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-metrics-certs\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-metrics-certs\") pod \"643040e9-8a0a-41c6-b231-e6445fac9845\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") "
Oct 30 22:36:41.642513 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.642404    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/643040e9-8a0a-41c6-b231-e6445fac9845-kube-api-access-s5fqd\" (UniqueName: \"kubernetes.io/projected/643040e9-8a0a-41c6-b231-e6445fac9845-kube-api-access-s5fqd\") pod \"643040e9-8a0a-41c6-b231-e6445fac9845\" (UID: \"643040e9-8a0a-41c6-b231-e6445fac9845\") "
Oct 30 22:36:41.642678 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.642650    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/643040e9-8a0a-41c6-b231-e6445fac9845-openshift-service-ca" pod "643040e9-8a0a-41c6-b231-e6445fac9845" (UID: "643040e9-8a0a-41c6-b231-e6445fac9845"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:41.642847 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.642821    5575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/643040e9-8a0a-41c6-b231-e6445fac9845-openshift-service-ca\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:41.644706 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.644677    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-metrics-certs" pod "643040e9-8a0a-41c6-b231-e6445fac9845" (UID: "643040e9-8a0a-41c6-b231-e6445fac9845"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:41.644835 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.644775    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/643040e9-8a0a-41c6-b231-e6445fac9845-kube-api-access-s5fqd" pod "643040e9-8a0a-41c6-b231-e6445fac9845" (UID: "643040e9-8a0a-41c6-b231-e6445fac9845"). InnerVolumeSpecName "kube-api-access-s5fqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:41.644835 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.644792    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls" pod "643040e9-8a0a-41c6-b231-e6445fac9845" (UID: "643040e9-8a0a-41c6-b231-e6445fac9845"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:41.744020 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.743984    5575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-maas-api-tls\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:41.744020 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.744017    5575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/643040e9-8a0a-41c6-b231-e6445fac9845-metrics-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:41.744231 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.744033    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5fqd\" (UniqueName: \"kubernetes.io/projected/643040e9-8a0a-41c6-b231-e6445fac9845-kube-api-access-s5fqd\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:41.796468 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.796439    5575 generic.go:356] "Generic (PLEG): container finished" podID="643040e9-8a0a-41c6-b231-e6445fac9845" containerID="9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7" exitCode=0
Oct 30 22:36:41.796659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.796488    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"
Oct 30 22:36:41.796659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.796520    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4" event={"ID":"643040e9-8a0a-41c6-b231-e6445fac9845","Type":"ContainerDied","Data":"9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7"}
Oct 30 22:36:41.796659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.796578    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4" event={"ID":"643040e9-8a0a-41c6-b231-e6445fac9845","Type":"ContainerDied","Data":"1bc604046a100e3a0ccad0cc43a8813d1e092e12ef413ea6d1f47a9de5ae3dad"}
Oct 30 22:36:41.796659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.796620    5575 scope.go:122] "RemoveContainer" containerID="9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7"
Oct 30 22:36:41.807473 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.807454    5575 scope.go:122] "RemoveContainer" containerID="9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7"
Oct 30 22:36:41.807758 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:36:41.807739    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7\": container with ID starting with 9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7 not found: ID does not exist" containerID="9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7"
Oct 30 22:36:41.807828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.807766    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7"} err="failed to get container status \"9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7\": rpc error: code = NotFound desc = could not find container \"9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7\": container with ID starting with 9802a700655de0955d0342c6a971d1655358e96cf5e6f50ffd199d76cf67c2d7 not found: ID does not exist"
Oct 30 22:36:41.962181 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.962146    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"]
Oct 30 22:36:41.966662 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:41.966638    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-563990-856f58d98b-9sbr4"]
Oct 30 22:36:42.958916 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:42.958884    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:43.125797 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:43.125766    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="643040e9-8a0a-41c6-b231-e6445fac9845" path="/var/lib/kubelet/pods/643040e9-8a0a-41c6-b231-e6445fac9845/volumes"
Oct 30 22:36:43.264278 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:43.264206    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:44.073015 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:44.072955    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:50.606111 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:50.606079    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:50.774003 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:50.773958    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:50.992844 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:36:50.992814    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:53.485607 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:36:53.485569    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:37:00.048497 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:00.048284    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"]
Oct 30 22:37:00.050944 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:00.050917    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-2nvlc"]
Oct 30 22:37:01.130217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:01.130166    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be" path="/var/lib/kubelet/pods/8e526b75-6e7b-4c8d-b3fe-01f5b3f4a0be/volumes"
Oct 30 22:37:06.682364 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:06.682325    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:23.665533 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:37:23.665449    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:37:28.048348 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:28.048313    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"]
Oct 30 22:37:28.066678 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:28.066646    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fm2c5"]
Oct 30 22:37:29.125492 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:29.125458    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b33a2b8-30b6-4b27-a76b-a6e953aa045d" path="/var/lib/kubelet/pods/9b33a2b8-30b6-4b27-a76b-a6e953aa045d/volumes"
Oct 30 22:37:53.485951 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:37:53.485912    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:37:57.060752 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:57.060722    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"]
Oct 30 22:37:57.114794 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:57.111388    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ad2fbdee-8c76d"]
Oct 30 22:37:57.128400 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:37:57.128360    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="838fe7b2-473b-4ed9-a953-983178ecca92" path="/var/lib/kubelet/pods/838fe7b2-473b-4ed9-a953-983178ecca92/volumes"
Oct 30 22:38:07.030238 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:07.030205    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:12.801408 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:12.801370    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65bd759848-6rl4v_84a98f42-a77d-43cb-a7f9-5ac1d48830f3/authorino/0.log"
Oct 30 22:38:20.021477 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:20.021450    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:38:20.036447 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:20.036423    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:38:20.040774 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:20.040754    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:38:20.054204 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:20.054188    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:38:21.311514 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:21.311486    5575 scope.go:122] "RemoveContainer" containerID="82bb241582e5e9cd2a48cbc060aa86ae23b6208d7d4621da6d017be79b6fb0fd"
Oct 30 22:38:23.488597 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:38:23.488550    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:38:34.168462 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:34.168435    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-trrhk_ac58a90c-a768-4ba1-80a2-0e84ae0a102b/manager/0.log"
Oct 30 22:38:34.449828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:34.449756    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-9cjz7_8047500b-7a83-47fa-a632-646c9f7964d0/manager/0.log"
Oct 30 22:38:36.087424 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:36.087395    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-t2f8s_c1144bae-6f6e-49f9-b8a4-fe44d80a4a40/manager/0.log"
Oct 30 22:38:37.300717 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:37.300682    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5bb5fc9b7-8n6fc_95cf6cf0-4dfc-4389-89f0-f5b0d8955456/maas-api/0.log"
Oct 30 22:38:38.631980 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:38.631934    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-hhgtr_cd3206bd-3b48-4d2b-8117-6ef55de0e4bf/postgres/0.log"
Oct 30 22:38:50.482624 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:50.482589    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65bd759848-6rl4v_84a98f42-a77d-43cb-a7f9-5ac1d48830f3/authorino/0.log"
Oct 30 22:38:50.963548 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:50.963513    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-ks4qd_c8fab499-5120-4ae1-a616-922f865cb453/manager/0.log"
Oct 30 22:38:51.204830 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:51.204799    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-6cq94_00611608-e98a-436f-a822-860104a61b4a/manager/0.log"
Oct 30 22:38:51.704060 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:51.704028    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-7rk76_5bcef66c-cc8c-4494-bea5-3224935c832c/manager/0.log"
Oct 30 22:38:52.255462 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:52.255428    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-wctn4_4e74afc9-e5b8-4f6e-8906-6fc741c80135/manager/0.log"
Oct 30 22:38:53.085850 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:53.085818    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-84d4d45d7cj8467_873d8eb5-e464-48c1-8eee-d23233240558/istio-proxy/0.log"
Oct 30 22:38:53.485422 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:38:53.485389    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:38:54.381555 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:54.381521    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-699hj_94aaf2f0-2807-4984-b257-87721376140b/istio-proxy/0.log"
Oct 30 22:38:54.661449 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:54.661372    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-7btv2_a568811c-c487-4c5c-a787-d629df1b57a8/istio-proxy/0.log"
Oct 30 22:38:55.879390 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:55.879364    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-rmjwj_0e62be6b-d1ec-45a8-8087-acb36d42c93a/istio-proxy/0.log"
Oct 30 22:38:56.450085 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:56.450036    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-w8pps_976ed6a3-bff2-4e78-85a8-c9b36cffd788/istio-proxy/0.log"
Oct 30 22:38:56.733617 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:56.733535    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc_2dfb6114-d082-4b6c-8198-5b8d3a13601c/istio-proxy/0.log"
Oct 30 22:38:57.215924 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:57.215895    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-bqfjc_248fa973-af6e-4765-8524-dcebe743bda6/payload-processing/0.log"
Oct 30 22:38:57.447900 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:57.447870    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bc45fc97-b8kwb_0dae4f31-8ea9-480a-881f-61bad1def6bc/router/0.log"
Oct 30 22:38:58.607216 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:58.607184    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-8xq9m_556b0f73-77d7-4830-a303-e40440b8230b/main/0.log"
Oct 30 22:38:58.879589 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:58.879512    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-fdpk7_8f549cab-2622-41f2-a1a6-cde3e9928078/main/0.log"
Oct 30 22:38:59.388990 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:38:59.388937    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq_3acf89da-f35f-4662-bd3d-e2155158f16c/main/0.log"
Oct 30 22:39:00.235932 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:00.235901    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f_5550810b-b9ac-4e61-a2de-c00bec116d9f/main/0.log"
Oct 30 22:39:01.276443 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:01.276416    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65bd759848-6rl4v_84a98f42-a77d-43cb-a7f9-5ac1d48830f3/authorino/0.log"
Oct 30 22:39:07.401306 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:07.401274    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:14.443100 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:14.443067    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:15.355173 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:15.355138    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:21.344716 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:21.344686    5575 scope.go:122] "RemoveContainer" containerID="1e1e723f7a450acf55bc958467aeb92a94403c6158ab00aeae24b1ee1389da3d"
Oct 30 22:39:21.354152 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:21.354128    5575 scope.go:122] "RemoveContainer" containerID="dbaed017f07c1a66a835a72dfa82d1a2f204ae226d1cb171bdc9fd297bd48e25"
Oct 30 22:39:23.485151 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:39:23.485118    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:39:31.254853 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:31.254804    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-trrhk_ac58a90c-a768-4ba1-80a2-0e84ae0a102b/manager/0.log"
Oct 30 22:39:31.523847 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:31.523775    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-9cjz7_8047500b-7a83-47fa-a632-646c9f7964d0/manager/0.log"
Oct 30 22:39:32.746511 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:32.746482    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-t2f8s_c1144bae-6f6e-49f9-b8a4-fe44d80a4a40/manager/0.log"
Oct 30 22:39:33.768106 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:33.768072    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5bb5fc9b7-8n6fc_95cf6cf0-4dfc-4389-89f0-f5b0d8955456/maas-api/0.log"
Oct 30 22:39:35.112094 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:35.112068    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-hhgtr_cd3206bd-3b48-4d2b-8117-6ef55de0e4bf/postgres/0.log"
Oct 30 22:39:36.338755 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:36.338719    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65bd759848-6rl4v_84a98f42-a77d-43cb-a7f9-5ac1d48830f3/authorino/0.log"
Oct 30 22:39:36.803634 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:36.803602    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-ks4qd_c8fab499-5120-4ae1-a616-922f865cb453/manager/0.log"
Oct 30 22:39:37.034889 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:37.034861    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-6cq94_00611608-e98a-436f-a822-860104a61b4a/manager/0.log"
Oct 30 22:39:37.492405 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:37.492379    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-7rk76_5bcef66c-cc8c-4494-bea5-3224935c832c/manager/0.log"
Oct 30 22:39:37.991207 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:37.991177    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-wctn4_4e74afc9-e5b8-4f6e-8906-6fc741c80135/manager/0.log"
Oct 30 22:39:38.635319 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:38.635287    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-84d4d45d7cj8467_873d8eb5-e464-48c1-8eee-d23233240558/istio-proxy/0.log"
Oct 30 22:39:39.950172 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:39.950145    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-699hj_94aaf2f0-2807-4984-b257-87721376140b/istio-proxy/0.log"
Oct 30 22:39:50.223886 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:50.223853    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-7btv2_a568811c-c487-4c5c-a787-d629df1b57a8/istio-proxy/0.log"
Oct 30 22:39:51.561313 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:51.561284    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-rmjwj_0e62be6b-d1ec-45a8-8087-acb36d42c93a/istio-proxy/0.log"
Oct 30 22:39:52.153481 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:52.153453    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-w8pps_976ed6a3-bff2-4e78-85a8-c9b36cffd788/istio-proxy/0.log"
Oct 30 22:39:52.429671 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:52.429602    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc_2dfb6114-d082-4b6c-8198-5b8d3a13601c/istio-proxy/0.log"
Oct 30 22:39:52.893819 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:52.893795    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-bqfjc_248fa973-af6e-4765-8524-dcebe743bda6/payload-processing/0.log"
Oct 30 22:39:53.128180 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:53.128157    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bc45fc97-b8kwb_0dae4f31-8ea9-480a-881f-61bad1def6bc/router/0.log"
Oct 30 22:39:53.487533 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:39:53.487499    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:39:54.030038 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:54.029998    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-8xq9m_556b0f73-77d7-4830-a303-e40440b8230b/main/0.log"
Oct 30 22:39:54.314403 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:54.314311    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-fdpk7_8f549cab-2622-41f2-a1a6-cde3e9928078/main/0.log"
Oct 30 22:39:54.844855 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:54.844822    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8bh6sq_3acf89da-f35f-4662-bd3d-e2155158f16c/main/0.log"
Oct 30 22:39:55.562236 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:39:55.562194    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-vxw5f_5550810b-b9ac-4e61-a2de-c00bec116d9f/main/0.log"
Oct 30 22:40:04.059432 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:40:04.059350    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:04.229654 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:40:04.229623    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:07.718219 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:40:07.718173    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:23.485869 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:40:23.485831    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:40:53.485721 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:40:53.485683    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:40:57.438216 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:40:57.438190    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-bqfjc_248fa973-af6e-4765-8524-dcebe743bda6/payload-processing/0.log"
Oct 30 22:41:07.662869 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:41:07.662844    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-bqfjc_248fa973-af6e-4765-8524-dcebe743bda6/payload-processing/0.log"
Oct 30 22:41:08.126230 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:41:08.126153    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:08.290789 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:41:08.290755    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:18.649329 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:41:18.649295    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:19.734291 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:41:19.734261    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:23.485633 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:41:23.485593    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:41:45.635732 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:41:45.635650    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:53.485429 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:41:53.485379    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:42:08.413741 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:42:08.413710    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:23.485715 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:42:23.485679    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:42:39.606779 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:42:39.606746    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-bqfjc_248fa973-af6e-4765-8524-dcebe743bda6/payload-processing/0.log"
Oct 30 22:42:39.835416 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:42:39.835386    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-bqfjc_248fa973-af6e-4765-8524-dcebe743bda6/payload-processing/0.log"
Oct 30 22:42:40.232944 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:42:40.232911    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:40.398676 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:42:40.398642    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:53.485708 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:42:53.485671    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:43:00.826854 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:00.826770    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s4z6n_a5515bc6-8312-4be8-999c-9072fa30b526/global-pull-secret-syncer/0.log"
Oct 30 22:43:01.452828 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:01.452801    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-7xpgb_7735f8ec-f901-4584-b995-6f5b4bb14a79/connection-checker/0.log"
Oct 30 22:43:01.887016 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:01.886990    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-h6pc5_e7b27302-be59-4dc9-8e64-0ea2b2f4baa2/connection-checker/0.log"
Oct 30 22:43:02.314659 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:02.314585    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-s5j2v_32575811-fcf4-4bcd-beb3-6bc4f0d472bd/connection-checker/0.log"
Oct 30 22:43:02.772937 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:02.772911    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log"
Oct 30 22:43:04.508470 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:04.508444    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-135.us-west-1.compute.internal_318fdbac2e696c24464ab55f83e20597/haproxy/0.log"
Oct 30 22:43:08.036923 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:08.036877    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65bd759848-6rl4v_84a98f42-a77d-43cb-a7f9-5ac1d48830f3/authorino/0.log"
Oct 30 22:43:08.357653 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:08.357562    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:43:08.359977 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:08.359942    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-ks4qd_c8fab499-5120-4ae1-a616-922f865cb453/manager/0.log"
Oct 30 22:43:08.764319 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:08.764287    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:43:08.781997 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:08.781939    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-6cq94_00611608-e98a-436f-a822-860104a61b4a/manager/0.log"
Oct 30 22:43:09.665612 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:09.665575    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-7rk76_5bcef66c-cc8c-4494-bea5-3224935c832c/manager/0.log"
Oct 30 22:43:10.000096 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:09.999938    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:43:10.534700 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:10.534671    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-wctn4_4e74afc9-e5b8-4f6e-8906-6fc741c80135/manager/0.log"
Oct 30 22:43:16.103720 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:16.103686    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-fwxj8_f9a3a4e1-69eb-46a4-bde6-5ccd1a00bdcb/cluster-monitoring-operator/0.log"
Oct 30 22:43:17.924498 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.924466    5575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"]
Oct 30 22:43:17.924975 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.924949    5575 cpu_manager.go:414] "containerMap: removing container" podUID="643040e9-8a0a-41c6-b231-e6445fac9845" containerName="maas-api"
Oct 30 22:43:17.925025 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.924977    5575 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="643040e9-8a0a-41c6-b231-e6445fac9845" containerName="maas-api"
Oct 30 22:43:17.925076 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.925066    5575 memory_manager.go:365] "RemoveStaleState removing state" podUID="643040e9-8a0a-41c6-b231-e6445fac9845" containerName="maas-api"
Oct 30 22:43:17.928176 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.928159    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:17.964401 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.964374    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-lib-modules\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:17.964531 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.964411    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-podres\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:17.964531 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.964436    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-proc\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:17.964616 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.964533    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtc5x\" (UniqueName: \"kubernetes.io/projected/398aa00f-2449-4b0a-90e1-e479fc49fe55-kube-api-access-rtc5x\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:17.964684 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:17.964660    5575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-sys\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.002101 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.002079    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mh4rx\"/\"kube-root-ca.crt\""
Oct 30 22:43:18.002222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.002137    5575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mh4rx\"/\"default-dockercfg-2gdt5\""
Oct 30 22:43:18.002222 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.002137    5575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mh4rx\"/\"openshift-service-ca.crt\""
Oct 30 22:43:18.037076 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.037039    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"]
Oct 30 22:43:18.065339 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.065307    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-sys\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.065494 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.065414    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-lib-modules\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.065494 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.065431    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-sys\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.065494 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.065457    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-podres\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.065494 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.065480    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-proc\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.065692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.065501    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-lib-modules\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.065692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.065516    5575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtc5x\" (UniqueName: \"kubernetes.io/projected/398aa00f-2449-4b0a-90e1-e479fc49fe55-kube-api-access-rtc5x\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.065692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.065549    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-podres\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.065692 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.065561    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/398aa00f-2449-4b0a-90e1-e479fc49fe55-proc\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.128162 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.128136    5575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtc5x\" (UniqueName: \"kubernetes.io/projected/398aa00f-2449-4b0a-90e1-e479fc49fe55-kube-api-access-rtc5x\") pod \"perf-node-gather-daemonset-lkdl6\" (UID: \"398aa00f-2449-4b0a-90e1-e479fc49fe55\") " pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.240437 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.240361    5575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:18.612977 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:18.612933    5575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"]
Oct 30 22:43:18.614472 ip-10-0-136-135 kubenswrapper[5575]: W1030 22:43:18.614448    5575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod398aa00f_2449_4b0a_90e1_e479fc49fe55.slice/crio-35337b78ed4ad694820e9a5e24e5262d1602d5a8191a783409ac9c9e30058dc5 WatchSource:0}: Error finding container 35337b78ed4ad694820e9a5e24e5262d1602d5a8191a783409ac9c9e30058dc5: Status 404 returned error can't find the container with id 35337b78ed4ad694820e9a5e24e5262d1602d5a8191a783409ac9c9e30058dc5
Oct 30 22:43:19.360573 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:19.360534    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6" event={"ID":"398aa00f-2449-4b0a-90e1-e479fc49fe55","Type":"ContainerStarted","Data":"db2636a62b83e7ad2ebe658729500ba7d25a626e7e28e74d87b26749d4630822"}
Oct 30 22:43:19.361057 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:19.360606    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6" event={"ID":"398aa00f-2449-4b0a-90e1-e479fc49fe55","Type":"ContainerStarted","Data":"35337b78ed4ad694820e9a5e24e5262d1602d5a8191a783409ac9c9e30058dc5"}
Oct 30 22:43:19.361057 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:19.360632    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:19.479535 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:19.479481    5575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6" podStartSLOduration=2.47946739 podStartE2EDuration="2.47946739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:43:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:43:19.47700236 +0000 UTC m=+4800.508850895" watchObservedRunningTime="2026-10-30 22:43:19.47946739 +0000 UTC m=+4800.511315972"
Oct 30 22:43:20.064266 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:20.064239    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:43:20.079179 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:20.079133    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:43:20.080629 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:20.080604    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p6mf4_16aa748d-0848-4d35-8522-527ce83ab9bb/node-exporter/0.log"
Oct 30 22:43:20.083072 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:20.083041    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cfwg_08c4cbb4-61e1-4aea-aa1c-4c7295592aaf/extract/0.log"
Oct 30 22:43:20.097290 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:20.097273    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:43:20.517649 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:20.517620    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p6mf4_16aa748d-0848-4d35-8522-527ce83ab9bb/kube-rbac-proxy/0.log"
Oct 30 22:43:20.943255 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:20.943228    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p6mf4_16aa748d-0848-4d35-8522-527ce83ab9bb/init-textfile/0.log"
Oct 30 22:43:23.487213 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:43:23.487180    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:43:25.377736 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:25.377710    5575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mh4rx/perf-node-gather-daemonset-lkdl6"
Oct 30 22:43:34.711107 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:34.711072    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-xc5td_7ade972d-dd5c-4128-bdd8-98647d69d3a8/networking-console-plugin/0.log"
Oct 30 22:43:37.445044 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:37.445007    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/2.log"
Oct 30 22:43:37.449457 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:37.449436    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hk9c_e4efa2f2-5d48-40f5-bfc2-d4f858a4c387/console-operator/3.log"
Oct 30 22:43:43.271227 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:43.271185    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-dz9pg_a5d11da4-5f47-4bba-bc30-54df80304964/volume-data-source-validator/0.log"
Oct 30 22:43:43.699587 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:43.699551    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"]
Oct 30 22:43:43.699782 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:43.699756    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" podUID="a568811c-c487-4c5c-a787-d629df1b57a8" containerName="istio-proxy" containerID="cri-o://a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877" gracePeriod=30
Oct 30 22:43:43.749463 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:43.749433    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"]
Oct 30 22:43:43.749663 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:43.749640    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" podUID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" containerName="istio-proxy" containerID="cri-o://112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0" gracePeriod=30
Oct 30 22:43:43.751712 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:43.751689    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"]
Oct 30 22:43:43.751884 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:43.751853    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" podUID="94aaf2f0-2807-4984-b257-87721376140b" containerName="istio-proxy" containerID="cri-o://e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b" gracePeriod=30
Oct 30 22:43:43.799418 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:43.799387    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"]
Oct 30 22:43:43.799608 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:43.799589    5575 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerName="istio-proxy" containerID="cri-o://e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03" gracePeriod=30
Oct 30 22:43:48.665219 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:48.665187    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7fr7k_df296dbb-fcbc-44be-ac0d-9dc2c84481cc/dns/0.log"
Oct 30 22:43:49.039362 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.039333    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:43:49.070885 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.070862    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:43:49.083829 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.083804    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7fr7k_df296dbb-fcbc-44be-ac0d-9dc2c84481cc/kube-rbac-proxy/0.log"
Oct 30 22:43:49.116336 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.116314    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:43:49.123867 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.123849    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:43:49.169584 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169557    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-envoy\") pod \"94aaf2f0-2807-4984-b257-87721376140b\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") "
Oct 30 22:43:49.169728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169586    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/94aaf2f0-2807-4984-b257-87721376140b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94aaf2f0-2807-4984-b257-87721376140b-istio-podinfo\") pod \"94aaf2f0-2807-4984-b257-87721376140b\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") "
Oct 30 22:43:49.169728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169614    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-envoy\") pod \"a568811c-c487-4c5c-a787-d629df1b57a8\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") "
Oct 30 22:43:49.169728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169632    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a568811c-c487-4c5c-a787-d629df1b57a8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a568811c-c487-4c5c-a787-d629df1b57a8-istio-podinfo\") pod \"a568811c-c487-4c5c-a787-d629df1b57a8\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") "
Oct 30 22:43:49.169728 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169651    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-credential-socket\") pod \"94aaf2f0-2807-4984-b257-87721376140b\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") "
Oct 30 22:43:49.170025 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169767    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-istio-token\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-istio-token\") pod \"94aaf2f0-2807-4984-b257-87721376140b\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") "
Oct 30 22:43:49.170025 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169809    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-certs\") pod \"a568811c-c487-4c5c-a787-d629df1b57a8\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") "
Oct 30 22:43:49.170025 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169852    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-data\") pod \"94aaf2f0-2807-4984-b257-87721376140b\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") "
Oct 30 22:43:49.170025 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169943    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-certs\") pod \"94aaf2f0-2807-4984-b257-87721376140b\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") "
Oct 30 22:43:49.170277 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170050    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-kube-api-access-ndq2s\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-kube-api-access-ndq2s\") pod \"a568811c-c487-4c5c-a787-d629df1b57a8\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") "
Oct 30 22:43:49.170277 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170082    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-istio-token\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-istio-token\") pod \"a568811c-c487-4c5c-a787-d629df1b57a8\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") "
Oct 30 22:43:49.170277 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170109    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-kube-api-access-7pcq7\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-kube-api-access-7pcq7\") pod \"94aaf2f0-2807-4984-b257-87721376140b\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") "
Oct 30 22:43:49.170277 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170156    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/94aaf2f0-2807-4984-b257-87721376140b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94aaf2f0-2807-4984-b257-87721376140b-istiod-ca-cert\") pod \"94aaf2f0-2807-4984-b257-87721376140b\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") "
Oct 30 22:43:49.170277 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170223    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-data\") pod \"a568811c-c487-4c5c-a787-d629df1b57a8\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") "
Oct 30 22:43:49.170277 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170259    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-socket\") pod \"94aaf2f0-2807-4984-b257-87721376140b\" (UID: \"94aaf2f0-2807-4984-b257-87721376140b\") "
Oct 30 22:43:49.170620 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170289    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-socket\") pod \"a568811c-c487-4c5c-a787-d629df1b57a8\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") "
Oct 30 22:43:49.170620 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170424    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-credential-socket\") pod \"a568811c-c487-4c5c-a787-d629df1b57a8\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") "
Oct 30 22:43:49.170620 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170515    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a568811c-c487-4c5c-a787-d629df1b57a8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a568811c-c487-4c5c-a787-d629df1b57a8-istiod-ca-cert\") pod \"a568811c-c487-4c5c-a787-d629df1b57a8\" (UID: \"a568811c-c487-4c5c-a787-d629df1b57a8\") "
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.169941    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-credential-socket" pod "94aaf2f0-2807-4984-b257-87721376140b" (UID: "94aaf2f0-2807-4984-b257-87721376140b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170174    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-certs" pod "a568811c-c487-4c5c-a787-d629df1b57a8" (UID: "a568811c-c487-4c5c-a787-d629df1b57a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170247    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-certs" pod "94aaf2f0-2807-4984-b257-87721376140b" (UID: "94aaf2f0-2807-4984-b257-87721376140b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.170429    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-data" pod "94aaf2f0-2807-4984-b257-87721376140b" (UID: "94aaf2f0-2807-4984-b257-87721376140b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.171314    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-socket" pod "94aaf2f0-2807-4984-b257-87721376140b" (UID: "94aaf2f0-2807-4984-b257-87721376140b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.172414    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-credential-socket" pod "a568811c-c487-4c5c-a787-d629df1b57a8" (UID: "a568811c-c487-4c5c-a787-d629df1b57a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.171585    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94aaf2f0-2807-4984-b257-87721376140b-istiod-ca-cert" pod "94aaf2f0-2807-4984-b257-87721376140b" (UID: "94aaf2f0-2807-4984-b257-87721376140b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.171805    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-data" pod "a568811c-c487-4c5c-a787-d629df1b57a8" (UID: "a568811c-c487-4c5c-a787-d629df1b57a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.172021    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-socket" pod "a568811c-c487-4c5c-a787-d629df1b57a8" (UID: "a568811c-c487-4c5c-a787-d629df1b57a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.172510 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.172112    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a568811c-c487-4c5c-a787-d629df1b57a8-istiod-ca-cert" pod "a568811c-c487-4c5c-a787-d629df1b57a8" (UID: "a568811c-c487-4c5c-a787-d629df1b57a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:43:49.173009 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.172708    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-kube-api-access-7pcq7" pod "94aaf2f0-2807-4984-b257-87721376140b" (UID: "94aaf2f0-2807-4984-b257-87721376140b"). InnerVolumeSpecName "kube-api-access-7pcq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:43:49.173009 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.172880    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-envoy" pod "a568811c-c487-4c5c-a787-d629df1b57a8" (UID: "a568811c-c487-4c5c-a787-d629df1b57a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.173115 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.173059    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-envoy" pod "94aaf2f0-2807-4984-b257-87721376140b" (UID: "94aaf2f0-2807-4984-b257-87721376140b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.173115 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.173086    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-istio-token" pod "94aaf2f0-2807-4984-b257-87721376140b" (UID: "94aaf2f0-2807-4984-b257-87721376140b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:43:49.173115 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.173090    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a568811c-c487-4c5c-a787-d629df1b57a8-istio-podinfo" pod "a568811c-c487-4c5c-a787-d629df1b57a8" (UID: "a568811c-c487-4c5c-a787-d629df1b57a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:43:49.173949 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.173928    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94aaf2f0-2807-4984-b257-87721376140b-istio-podinfo" pod "94aaf2f0-2807-4984-b257-87721376140b" (UID: "94aaf2f0-2807-4984-b257-87721376140b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:43:49.174283 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.174263    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-kube-api-access-ndq2s" pod "a568811c-c487-4c5c-a787-d629df1b57a8" (UID: "a568811c-c487-4c5c-a787-d629df1b57a8"). InnerVolumeSpecName "kube-api-access-ndq2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:43:49.174450 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.174431    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-istio-token" pod "a568811c-c487-4c5c-a787-d629df1b57a8" (UID: "a568811c-c487-4c5c-a787-d629df1b57a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:43:49.272191 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272156    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-kube-api-access-24wvb\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-kube-api-access-24wvb\") pod \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") "
Oct 30 22:43:49.272385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272199    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-certs\") pod \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") "
Oct 30 22:43:49.272385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272235    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-socket\") pod \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") "
Oct 30 22:43:49.272385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272252    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-certs\") pod \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") "
Oct 30 22:43:49.272385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272287    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-data\") pod \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") "
Oct 30 22:43:49.272385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272312    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-token\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-token\") pod \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") "
Oct 30 22:43:49.272385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272354    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-envoy\") pod \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") "
Oct 30 22:43:49.272385 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272387    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-credential-socket\") pod \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") "
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272431    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-podinfo\") pod \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") "
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272468    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istiod-ca-cert\") pod \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") "
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272502    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-data\") pod \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") "
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272503    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-certs" pod "0e62be6b-d1ec-45a8-8087-acb36d42c93a" (UID: "0e62be6b-d1ec-45a8-8087-acb36d42c93a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272528    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-token\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-token\") pod \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") "
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272598    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-certs" pod "976ed6a3-bff2-4e78-85a8-c9b36cffd788" (UID: "976ed6a3-bff2-4e78-85a8-c9b36cffd788"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272644    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-data" pod "976ed6a3-bff2-4e78-85a8-c9b36cffd788" (UID: "976ed6a3-bff2-4e78-85a8-c9b36cffd788"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272647    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-kube-api-access-phsp6\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-kube-api-access-phsp6\") pod \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") "
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272717    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-credential-socket" pod "0e62be6b-d1ec-45a8-8087-acb36d42c93a" (UID: "0e62be6b-d1ec-45a8-8087-acb36d42c93a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.272791 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272748    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istiod-ca-cert\") pod \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") "
Oct 30 22:43:49.273386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272805    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-podinfo\") pod \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") "
Oct 30 22:43:49.273386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272848    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-credential-socket\") pod \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") "
Oct 30 22:43:49.273386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272884    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-envoy\") pod \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\" (UID: \"0e62be6b-d1ec-45a8-8087-acb36d42c93a\") "
Oct 30 22:43:49.273386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.272948    5575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-socket\") pod \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\" (UID: \"976ed6a3-bff2-4e78-85a8-c9b36cffd788\") "
Oct 30 22:43:49.273386 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273150    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-socket" pod "0e62be6b-d1ec-45a8-8087-acb36d42c93a" (UID: "0e62be6b-d1ec-45a8-8087-acb36d42c93a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273545    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273566    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273582    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273596    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273611    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a568811c-c487-4c5c-a787-d629df1b57a8-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273625    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273638    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273652    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273666    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.273690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273683    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94aaf2f0-2807-4984-b257-87721376140b-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273698    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273713    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a568811c-c487-4c5c-a787-d629df1b57a8-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273727    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273740    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273757    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273770    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273793    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273807    5575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94aaf2f0-2807-4984-b257-87721376140b-workload-certs\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273823    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndq2s\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-kube-api-access-ndq2s\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273838    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a568811c-c487-4c5c-a787-d629df1b57a8-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273858    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pcq7\" (UniqueName: \"kubernetes.io/projected/94aaf2f0-2807-4984-b257-87721376140b-kube-api-access-7pcq7\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273873    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94aaf2f0-2807-4984-b257-87721376140b-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.273886    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a568811c-c487-4c5c-a787-d629df1b57a8-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.274235 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.274135    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-socket" pod "976ed6a3-bff2-4e78-85a8-c9b36cffd788" (UID: "976ed6a3-bff2-4e78-85a8-c9b36cffd788"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.275311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.274303    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istiod-ca-cert" pod "976ed6a3-bff2-4e78-85a8-c9b36cffd788" (UID: "976ed6a3-bff2-4e78-85a8-c9b36cffd788"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:43:49.275311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.274455    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istiod-ca-cert" pod "0e62be6b-d1ec-45a8-8087-acb36d42c93a" (UID: "0e62be6b-d1ec-45a8-8087-acb36d42c93a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:43:49.275311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.274473    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-data" pod "0e62be6b-d1ec-45a8-8087-acb36d42c93a" (UID: "0e62be6b-d1ec-45a8-8087-acb36d42c93a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.275311 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.274581    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-credential-socket" pod "976ed6a3-bff2-4e78-85a8-c9b36cffd788" (UID: "976ed6a3-bff2-4e78-85a8-c9b36cffd788"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.275551 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.275460    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-kube-api-access-phsp6" pod "976ed6a3-bff2-4e78-85a8-c9b36cffd788" (UID: "976ed6a3-bff2-4e78-85a8-c9b36cffd788"). InnerVolumeSpecName "kube-api-access-phsp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:43:49.275794 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.275772    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-kube-api-access-24wvb" pod "0e62be6b-d1ec-45a8-8087-acb36d42c93a" (UID: "0e62be6b-d1ec-45a8-8087-acb36d42c93a"). InnerVolumeSpecName "kube-api-access-24wvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:43:49.276024 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.276004    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-token" pod "0e62be6b-d1ec-45a8-8087-acb36d42c93a" (UID: "0e62be6b-d1ec-45a8-8087-acb36d42c93a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:43:49.276109 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.276082    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-token" pod "976ed6a3-bff2-4e78-85a8-c9b36cffd788" (UID: "976ed6a3-bff2-4e78-85a8-c9b36cffd788"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:43:49.276189 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.276167    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-podinfo" pod "0e62be6b-d1ec-45a8-8087-acb36d42c93a" (UID: "0e62be6b-d1ec-45a8-8087-acb36d42c93a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:43:49.276561 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.276536    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-envoy" pod "976ed6a3-bff2-4e78-85a8-c9b36cffd788" (UID: "976ed6a3-bff2-4e78-85a8-c9b36cffd788"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.276762 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.276740    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-envoy" pod "0e62be6b-d1ec-45a8-8087-acb36d42c93a" (UID: "0e62be6b-d1ec-45a8-8087-acb36d42c93a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:43:49.276837 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.276768    5575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-podinfo" pod "976ed6a3-bff2-4e78-85a8-c9b36cffd788" (UID: "976ed6a3-bff2-4e78-85a8-c9b36cffd788"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:43:49.375246 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375213    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375246 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375243    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375246 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375253    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375263    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375272    5575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-data\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375282    5575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-token\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375291    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phsp6\" (UniqueName: \"kubernetes.io/projected/976ed6a3-bff2-4e78-85a8-c9b36cffd788-kube-api-access-phsp6\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375301    5575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/976ed6a3-bff2-4e78-85a8-c9b36cffd788-istiod-ca-cert\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375310    5575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-podinfo\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375318    5575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-credential-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375327    5575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e62be6b-d1ec-45a8-8087-acb36d42c93a-istio-envoy\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375335    5575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ed6a3-bff2-4e78-85a8-c9b36cffd788-workload-socket\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.375475 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.375344    5575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24wvb\" (UniqueName: \"kubernetes.io/projected/0e62be6b-d1ec-45a8-8087-acb36d42c93a-kube-api-access-24wvb\") on node \"ip-10-0-136-135.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:49.539443 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.539360    5575 generic.go:356] "Generic (PLEG): container finished" podID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" containerID="e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03" exitCode=0
Oct 30 22:43:49.539443 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.539407    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"
Oct 30 22:43:49.539697 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.539443    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" event={"ID":"0e62be6b-d1ec-45a8-8087-acb36d42c93a","Type":"ContainerDied","Data":"e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03"}
Oct 30 22:43:49.539697 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.539496    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj" event={"ID":"0e62be6b-d1ec-45a8-8087-acb36d42c93a","Type":"ContainerDied","Data":"027c934b64306b59031cde312f209c98eca91501d5d8483a4fbb10c128a3d822"}
Oct 30 22:43:49.539697 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.539522    5575 scope.go:122] "RemoveContainer" containerID="e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03"
Oct 30 22:43:49.540937 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.540916    5575 generic.go:356] "Generic (PLEG): container finished" podID="94aaf2f0-2807-4984-b257-87721376140b" containerID="e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b" exitCode=0
Oct 30 22:43:49.541056 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.541005    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" event={"ID":"94aaf2f0-2807-4984-b257-87721376140b","Type":"ContainerDied","Data":"e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b"}
Oct 30 22:43:49.541056 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.541023    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"
Oct 30 22:43:49.541198 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.541053    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj" event={"ID":"94aaf2f0-2807-4984-b257-87721376140b","Type":"ContainerDied","Data":"5f60af1b46911244e624781a7a7ea350a48ca385e64c917c91deb49b43a367d9"}
Oct 30 22:43:49.543307 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.543282    5575 generic.go:356] "Generic (PLEG): container finished" podID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" containerID="112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0" exitCode=0
Oct 30 22:43:49.543417 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.543310    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" event={"ID":"976ed6a3-bff2-4e78-85a8-c9b36cffd788","Type":"ContainerDied","Data":"112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0"}
Oct 30 22:43:49.543417 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.543329    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"
Oct 30 22:43:49.543417 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.543368    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps" event={"ID":"976ed6a3-bff2-4e78-85a8-c9b36cffd788","Type":"ContainerDied","Data":"fe2706fef05ccc6cdba02603168328a177cf673c348717acea6acec790a33e34"}
Oct 30 22:43:49.544958 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.544921    5575 generic.go:356] "Generic (PLEG): container finished" podID="a568811c-c487-4c5c-a787-d629df1b57a8" containerID="a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877" exitCode=0
Oct 30 22:43:49.544958 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.544957    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" event={"ID":"a568811c-c487-4c5c-a787-d629df1b57a8","Type":"ContainerDied","Data":"a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877"}
Oct 30 22:43:49.545177 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.545019    5575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2" event={"ID":"a568811c-c487-4c5c-a787-d629df1b57a8","Type":"ContainerDied","Data":"2bd7fa94206e0ef5b5ee34cbfd79ff97e3a4b7f940005cc1ce11e4aecfb37708"}
Oct 30 22:43:49.545313 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.545289    5575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"
Oct 30 22:43:49.559291 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.556263    5575 scope.go:122] "RemoveContainer" containerID="e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03"
Oct 30 22:43:49.559291 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:43:49.558856    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03\": container with ID starting with e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03 not found: ID does not exist" containerID="e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03"
Oct 30 22:43:49.559291 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.558893    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03"} err="failed to get container status \"e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03\": rpc error: code = NotFound desc = could not find container \"e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03\": container with ID starting with e1b40ca466c87a3eceb7ea491ea4ebe55976852d5ca80c8c8437af8fa21a5d03 not found: ID does not exist"
Oct 30 22:43:49.559291 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.558916    5575 scope.go:122] "RemoveContainer" containerID="e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b"
Oct 30 22:43:49.570211 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.570191    5575 scope.go:122] "RemoveContainer" containerID="e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b"
Oct 30 22:43:49.570476 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:43:49.570459    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b\": container with ID starting with e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b not found: ID does not exist" containerID="e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b"
Oct 30 22:43:49.570540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.570483    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b"} err="failed to get container status \"e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b\": rpc error: code = NotFound desc = could not find container \"e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b\": container with ID starting with e8e06ddfdce68c7d9e08bcc9580f2e328c2d4c52af8494805463bcf85de9cd0b not found: ID does not exist"
Oct 30 22:43:49.570540 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.570497    5575 scope.go:122] "RemoveContainer" containerID="112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0"
Oct 30 22:43:49.579358 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.579326    5575 scope.go:122] "RemoveContainer" containerID="112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0"
Oct 30 22:43:49.579619 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:43:49.579597    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0\": container with ID starting with 112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0 not found: ID does not exist" containerID="112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0"
Oct 30 22:43:49.579696 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.579629    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0"} err="failed to get container status \"112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0\": rpc error: code = NotFound desc = could not find container \"112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0\": container with ID starting with 112ea5cb3031c7af75b2f80cf48e3a143ddd80600b99b438b6fc5f6561b25da0 not found: ID does not exist"
Oct 30 22:43:49.579696 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.579652    5575 scope.go:122] "RemoveContainer" containerID="a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877"
Oct 30 22:43:49.588099 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.588080    5575 scope.go:122] "RemoveContainer" containerID="a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877"
Oct 30 22:43:49.588354 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:43:49.588335    5575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877\": container with ID starting with a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877 not found: ID does not exist" containerID="a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877"
Oct 30 22:43:49.588406 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.588363    5575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877"} err="failed to get container status \"a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877\": rpc error: code = NotFound desc = could not find container \"a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877\": container with ID starting with a058200238dd66f881c0858313f7ce0d5fa94c4bd88333644fd221f4c543e877 not found: ID does not exist"
Oct 30 22:43:49.706804 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.706778    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"]
Oct 30 22:43:49.710012 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.709989    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-7btv2"]
Oct 30 22:43:49.821137 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.821075    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"]
Oct 30 22:43:49.827019 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.826998    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rmjwj"]
Oct 30 22:43:49.941008 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.940981    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"]
Oct 30 22:43:49.956690 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:49.956666    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-w8pps"]
Oct 30 22:43:50.067781 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:50.067752    5575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"]
Oct 30 22:43:50.078217 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:50.078157    5575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-699hj"]
Oct 30 22:43:51.126253 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:51.126216    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e62be6b-d1ec-45a8-8087-acb36d42c93a" path="/var/lib/kubelet/pods/0e62be6b-d1ec-45a8-8087-acb36d42c93a/volumes"
Oct 30 22:43:51.126642 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:51.126628    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="94aaf2f0-2807-4984-b257-87721376140b" path="/var/lib/kubelet/pods/94aaf2f0-2807-4984-b257-87721376140b/volumes"
Oct 30 22:43:51.127025 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:51.127013    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="976ed6a3-bff2-4e78-85a8-c9b36cffd788" path="/var/lib/kubelet/pods/976ed6a3-bff2-4e78-85a8-c9b36cffd788/volumes"
Oct 30 22:43:51.127695 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:51.127681    5575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a568811c-c487-4c5c-a787-d629df1b57a8" path="/var/lib/kubelet/pods/a568811c-c487-4c5c-a787-d629df1b57a8/volumes"
Oct 30 22:43:51.631151 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:51.631122    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cgnp7_2523fa7a-1747-4695-a737-5c2a1caf2864/dns-node-resolver/0.log"
Oct 30 22:43:53.485278 ip-10-0-136-135 kubenswrapper[5575]: E1030 22:43:53.485241    5575 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jbkhl" containerName="extractor"
Oct 30 22:43:55.773345 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:43:55.773313    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4gdh_6bfa550e-e2f4-4549-993f-5bbe3ebac5c2/node-ca/0.log"
Oct 30 22:44:00.757638 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:44:00.757610    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-84d4d45d7cj8467_873d8eb5-e464-48c1-8eee-d23233240558/istio-proxy/0.log"
Oct 30 22:44:04.356485 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:44:04.356454    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5cf4665f7f-pc6rc_2dfb6114-d082-4b6c-8198-5b8d3a13601c/istio-proxy/0.log"
Oct 30 22:44:05.208921 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:44:05.208890    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-bqfjc_248fa973-af6e-4765-8524-dcebe743bda6/payload-processing/0.log"
Oct 30 22:44:05.646321 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:44:05.646296    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bc45fc97-b8kwb_0dae4f31-8ea9-480a-881f-61bad1def6bc/router/0.log"
Oct 30 22:44:09.166382 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:44:09.166346    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:44:09.358435 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:44:09.358401    5575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5szpn_7f630f6b-6df2-4c78-9aff-8f2577cfb56c/konnectivity-agent/0.log" limit=1024
Oct 30 22:44:09.734127 ip-10-0-136-135 kubenswrapper[5575]: I1030 22:44:09.734096    5575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g8nnl_eb9de1fa-933d-49a5-84ed-2418c40eead3/serve-healthcheck-canary/0.log"